Install SystemDS

SystemDS can be installed via pip or installed from source.

Pip

Installation is quite simple with pip, just execute the following command:

pip install systemds

SystemDS is a java-project, the pip package contains all the necessary jars, but you will need java version 8 installed. Do not use an older or newer version of java, because SystemDS is non compatible with other java versions.

Check the output of java -version. The output should look similar to:

openjdk version "1.8.0_242"
OpenJDK Runtime Environment (build 1.8.0_242-b08)
OpenJDK 64-Bit Server VM (build 25.242-b08, mixed mode)

The important part is in the first line openjdk version "1.8.0_xxx", please make sure this is the case.

Source

To Install from source involves multiple steps.

Install Dependencies

Once installed you please verify your version numbers. Additionally you have to install a few python packages. We sugest to create a new virtual environment using virtualenv. All commands are run inside src/main/python/. We asume that in the following scripts python==python3

python -m venv python_venv

Now, we activate the environment.

source python_venv/bin/activate

In case of using Linux. For Windows PowerShell use:

Set-ExecutionPolicy -ExecutionPolicy Bypass -Scope Process -Force python_venv/Scripts/Activate.ps1

Note depending on your installation you might need to use pip3 instead of pip:

pip install numpy py4j wheel requests

Then to build the system you do the following

  • Clone the Git Repository: https://github.com/apache/systemds.git

  • Open an terminal at the root of the repository.

  • Package the Java code using the mvn clean package -P distribution command

  • cd src/main/python to point at the root of the SystemDS Python library.

  • Build the Python API python create_python_dist.py

  • Install with pip install .

After this you are ready to go.