org.apache.sysds.hops.rewrite

Class RewriteInjectSparkLoopCheckpointing

java.lang.Object

org.apache.sysds.hops.rewrite.StatementBlockRewriteRule

org.apache.sysds.hops.rewrite.RewriteInjectSparkLoopCheckpointing

public class RewriteInjectSparkLoopCheckpointing
extends StatementBlockRewriteRule

Rule: Insert checkpointing operations for caching purposes. Currently, we follow a heuristic of checkpointing (1) all variables used read-only in loops, and (2) intermediates used by multiple consumers. TODO (2) implement injection for multiple consumers (local and global).

Constructor Summary

Constructors

Constructor and Description
RewriteInjectSparkLoopCheckpointing(boolean checkParForContext)

Method Summary

Modifier and Type	Method and Description
boolean	createsSplitDag() Indicates if the rewrite potentially splits dags, which is used for phase ordering of rewrites.
List<StatementBlock>	rewriteStatementBlock(StatementBlock sb, ProgramRewriteStatus status) Handle an arbitrary statement block.
List<StatementBlock>	rewriteStatementBlocks(List<StatementBlock> sbs, ProgramRewriteStatus sate) Handle a list of statement blocks.

Methods inherited from class org.apache.sysds.hops.rewrite.StatementBlockRewriteRule

createCutVarName

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

RewriteInjectSparkLoopCheckpointing

public RewriteInjectSparkLoopCheckpointing(boolean checkParForContext)

Method Detail

createsSplitDag

public boolean createsSplitDag()

Description copied from class: StatementBlockRewriteRule

Indicates if the rewrite potentially splits dags, which is used for phase ordering of rewrites.

Specified by:

createsSplitDag in class StatementBlockRewriteRule

Returns:

true if dag splits are possible.

rewriteStatementBlock

public List<StatementBlock> rewriteStatementBlock(StatementBlock sb,
                                                  ProgramRewriteStatus status)

Description copied from class: StatementBlockRewriteRule

Handle an arbitrary statement block. Specific type constraints have to be ensured within the individual rewrites. If a rewrite does not apply to individual blocks, it should simply return the input block.

Specified by:

rewriteStatementBlock in class StatementBlockRewriteRule

Parameters:

sb - statement block

status - program rewrite status

Returns:

list of statement blocks

rewriteStatementBlocks

public List<StatementBlock> rewriteStatementBlocks(List<StatementBlock> sbs,
                                                   ProgramRewriteStatus sate)

Description copied from class: StatementBlockRewriteRule

Handle a list of statement blocks. Specific type constraints have to be ensured within the individual rewrites. If a rewrite does not require sequence access, it should simply return the input list of statement blocks.

Specified by:

rewriteStatementBlocks in class StatementBlockRewriteRule

Parameters:

sbs - list of statement blocks

sate - program rewrite status

Returns:

list of statement blocks