SystemDS Documentation

SystemDS is a flexible, scalable machine learning system. SystemDS’s distinguishing characteristics are:

  1. Algorithm customizability via R-like and Python-like languages.
  2. Multiple execution modes, including Spark MLContext, Spark Batch, Standalone, and JMLC.
  3. Automatic optimization based on data and cluster characteristics to ensure both efficiency and scalability.

This version of SystemDS supports: Java 8+, Python 3.5+, Hadoop 2.6+ (Not 3.X), and Spark 2.1+ (Not 3.X) Nvidia CUDA 10.2 (CuDNN 7.x) Intel MKL (<=2019.x).

Various forms of documentation for SystemDS are available.