org.apache.sysml.api

Class DMLScript

java.lang.Object

org.apache.sysml.api.DMLScript

public class DMLScript
extends Object

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	DMLScript.EvictionPolicy Eviction policies for eviction of GPU objects.
static class	DMLScript.RUNTIME_PLATFORM

Field Summary

Fields

Modifier and Type	Field and Description
static boolean	_activeAM
static boolean	_suppressPrint2Stdout
static String	_uuid
static String	DML_FILE_PATH_ANTLR_PARSER
static boolean	EAGER_CUDA_FREE
static boolean	ENABLE_DEBUG_MODE
static long	EVICTION_SHADOW_BUFFER_CURR_BYTES
static long	EVICTION_SHADOW_BUFFER_MAX_BYTES
static org.apache.sysml.utils.Explain.ExplainType	EXPLAIN
static boolean	FINEGRAINED_STATISTICS
static String	FLOATING_POINT_PRECISION
static boolean	FORCE_ACCELERATOR
static DMLScript.EvictionPolicy	GPU_EVICTION_POLICY
static String	GPU_MEMORY_ALLOCATOR
static double	GPU_MEMORY_UTILIZATION_FACTOR
static boolean	JMLC_MEM_STATISTICS
static boolean	PRINT_GPU_MEMORY_INFO
static DMLScript.RUNTIME_PLATFORM	rtplatform
static ScriptType	SCRIPT_TYPE Global variable indicating the script type (DML or PYDML).
static boolean	STATISTICS
static int	STATISTICS_COUNT
static int	STATISTICS_MAX_WRAP_LEN
static boolean	SYNCHRONIZE_GPU
static boolean	USE_ACCELERATOR
static boolean	USE_LOCAL_SPARK_CONFIG
static boolean	VALIDATOR_IGNORE_ISSUES If true, allow DMLProgram to be generated while not halting due to validation errors/warnings

Constructor Summary

Constructors

Constructor and Description
DMLScript()

Method Summary

Modifier and Type	Method and Description
static void	cleanupHadoopExecution(org.apache.sysml.conf.DMLConfig config)
static boolean	executeScript(org.apache.hadoop.conf.Configuration conf, String[] args) Single entry point for all public invocation alternatives (e.g., main, executeScript, JaqlUdf etc)
static String	getUUID()
static void	initHadoopExecution(org.apache.sysml.conf.DMLConfig config)
static boolean	isActiveAM()
static void	main(String[] args)
protected static String	readDMLScript(boolean isFile, String scriptOrFilename) Reads the DML/PyDML script into a String
static void	setActiveAM()
static void	setGlobalFlags(org.apache.sysml.conf.DMLConfig dmlconf) Sets the global flags in DMLScript based on user provided configuration
static void	setUUID(String uuid) Used to set master UUID on all nodes (in parfor remote_mr, where DMLScript passed) in order to simplify cleanup of scratch_space and local working dirs.
static boolean	suppressPrint2Stdout()

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

rtplatform

public static DMLScript.RUNTIME_PLATFORM rtplatform

STATISTICS

public static boolean STATISTICS

FINEGRAINED_STATISTICS

public static boolean FINEGRAINED_STATISTICS

JMLC_MEM_STATISTICS

public static boolean JMLC_MEM_STATISTICS

STATISTICS_COUNT

public static int STATISTICS_COUNT

STATISTICS_MAX_WRAP_LEN

public static int STATISTICS_MAX_WRAP_LEN

ENABLE_DEBUG_MODE

public static boolean ENABLE_DEBUG_MODE

EXPLAIN

public static org.apache.sysml.utils.Explain.ExplainType EXPLAIN

DML_FILE_PATH_ANTLR_PARSER

public static String DML_FILE_PATH_ANTLR_PARSER

FLOATING_POINT_PRECISION

public static String FLOATING_POINT_PRECISION

GPU_EVICTION_POLICY

public static DMLScript.EvictionPolicy GPU_EVICTION_POLICY

PRINT_GPU_MEMORY_INFO

public static boolean PRINT_GPU_MEMORY_INFO

EVICTION_SHADOW_BUFFER_MAX_BYTES

public static long EVICTION_SHADOW_BUFFER_MAX_BYTES

EVICTION_SHADOW_BUFFER_CURR_BYTES

public static long EVICTION_SHADOW_BUFFER_CURR_BYTES

GPU_MEMORY_UTILIZATION_FACTOR

public static double GPU_MEMORY_UTILIZATION_FACTOR

GPU_MEMORY_ALLOCATOR

public static String GPU_MEMORY_ALLOCATOR

SCRIPT_TYPE

public static ScriptType SCRIPT_TYPE

Global variable indicating the script type (DML or PYDML). Can be used for DML/PYDML-specific tasks, such as outputting booleans in the correct case (TRUE/FALSE for DML and True/False for PYDML).

USE_ACCELERATOR

public static boolean USE_ACCELERATOR

FORCE_ACCELERATOR

public static boolean FORCE_ACCELERATOR

SYNCHRONIZE_GPU

public static boolean SYNCHRONIZE_GPU

EAGER_CUDA_FREE

public static boolean EAGER_CUDA_FREE

_suppressPrint2Stdout

public static boolean _suppressPrint2Stdout

USE_LOCAL_SPARK_CONFIG

public static boolean USE_LOCAL_SPARK_CONFIG

_activeAM

public static boolean _activeAM

VALIDATOR_IGNORE_ISSUES

public static boolean VALIDATOR_IGNORE_ISSUES

If true, allow DMLProgram to be generated while not halting due to validation errors/warnings

_uuid

public static String _uuid

Constructor Detail

DMLScript

public DMLScript()

Method Detail

getUUID

public static String getUUID()

setUUID

public static void setUUID(String uuid)

Used to set master UUID on all nodes (in parfor remote_mr, where DMLScript passed) in order to simplify cleanup of scratch_space and local working dirs.

Parameters:

uuid - master UUID to set on all nodes

suppressPrint2Stdout

public static boolean suppressPrint2Stdout()

setActiveAM

public static void setActiveAM()

isActiveAM

public static boolean isActiveAM()

main

public static void main(String[] args)
                 throws IOException

Parameters:

args - command-line arguments

Throws:

IOException - if an IOException occurs

executeScript

public static boolean executeScript(org.apache.hadoop.conf.Configuration conf,
                                    String[] args)

Single entry point for all public invocation alternatives (e.g., main, executeScript, JaqlUdf etc)

Parameters:

conf - Hadoop configuration

args - arguments

Returns:

true if success, false otherwise

readDMLScript

protected static String readDMLScript(boolean isFile,
                                      String scriptOrFilename)
                               throws IOException

Reads the DML/PyDML script into a String

Parameters:

isFile - Whether the string argument is a path to a file or the script itself

scriptOrFilename - script or filename

Returns:

a string representation of the script

Throws:

IOException - if error

setGlobalFlags

public static void setGlobalFlags(org.apache.sysml.conf.DMLConfig dmlconf)

Sets the global flags in DMLScript based on user provided configuration

Parameters:

dmlconf - user provided configuration

initHadoopExecution

public static void initHadoopExecution(org.apache.sysml.conf.DMLConfig config)
                                throws IOException,
                                       org.apache.sysml.parser.ParseException,
                                       DMLRuntimeException

Throws:

IOException

org.apache.sysml.parser.ParseException

DMLRuntimeException

cleanupHadoopExecution

public static void cleanupHadoopExecution(org.apache.sysml.conf.DMLConfig config)
                                   throws IOException,
                                          org.apache.sysml.parser.ParseException

Throws:

IOException

org.apache.sysml.parser.ParseException