| Modifier and Type | Method and Description |
|---|---|
MatrixBlock |
Connection.convertToMatrix(InputStream input,
int rows,
int cols)
Converts an input stream of a string matrix in textcell format
into a matrix block.
|
MatrixBlock |
Connection.convertToMatrix(InputStream input,
int rows,
int cols,
String format)
Converts an input stream of a string matrix in csv or textcell format
into a matrix block.
|
MatrixBlock |
Connection.convertToMatrix(InputStream input,
String meta)
Converts an input stream of a string matrix in csv or textcell format
into a matrix block.
|
MatrixBlock |
Connection.convertToMatrix(String input,
int rows,
int cols)
Converts an input string representation of a matrix in textcell format
into a matrix block.
|
MatrixBlock |
Connection.convertToMatrix(String input,
String meta)
Converts an input string representation of a matrix in csv or textcell format
into a matrix block.
|
MatrixBlock |
ResultVariables.getMatrixBlock(String varname)
Obtain the matrix represented by the given output variable.
|
| Modifier and Type | Method and Description |
|---|---|
void |
PreparedScript.setMatrix(String varname,
MatrixBlock matrix,
boolean reuse)
Binds a matrix object to a registered input variable.
|
| Modifier and Type | Method and Description |
|---|---|
static MatrixBlock |
MLContextConversionUtil.binaryBlocksToMatrixBlock(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> binaryBlocks,
MatrixMetadata matrixMetadata)
Convert a
JavaPairRDD<MatrixIndexes, MatrixBlock> to a
MatrixBlock |
MatrixBlock |
Matrix.toMatrixBlock()
Obtain the matrix as a
MatrixBlock |
| Modifier and Type | Method and Description |
|---|---|
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
MLContextConversionUtil.dataFrameToMatrixBinaryBlocks(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataFrame)
Convert a
DataFrame to a
JavaPairRDD<MatrixIndexes, MatrixBlock> binary-block matrix. |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
MLContextConversionUtil.dataFrameToMatrixBinaryBlocks(org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> dataFrame,
MatrixMetadata matrixMetadata)
Convert a
DataFrame to a
JavaPairRDD<MatrixIndexes, MatrixBlock> binary-block matrix. |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
MLContextConversionUtil.matrixObjectToBinaryBlocks(org.apache.sysml.runtime.controlprogram.caching.MatrixObject matrixObject,
org.apache.sysml.runtime.controlprogram.context.SparkExecutionContext sparkExecutionContext)
Convert a
MatrixObject to a
JavaPairRDD<MatrixIndexes, MatrixBlock>. |
org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
Matrix.toBinaryBlocks()
Obtain the matrix as a
JavaPairRDD<MatrixIndexes, MatrixBlock> |
| Modifier and Type | Method and Description |
|---|---|
static org.apache.sysml.runtime.controlprogram.caching.MatrixObject |
MLContextConversionUtil.matrixBlockToMatrixObject(String variableName,
MatrixBlock matrixBlock,
MatrixMetadata matrixMetadata)
Convert a
MatrixBlock to a MatrixObject. |
| Modifier and Type | Method and Description |
|---|---|
static MatrixBlock |
MLContextConversionUtil.binaryBlocksToMatrixBlock(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> binaryBlocks,
MatrixMetadata matrixMetadata)
Convert a
JavaPairRDD<MatrixIndexes, MatrixBlock> to a
MatrixBlock |
static org.apache.sysml.runtime.controlprogram.caching.MatrixObject |
MLContextConversionUtil.binaryBlocksToMatrixObject(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> binaryBlocks)
Convert a
JavaPairRDD<MatrixIndexes, MatrixBlock> to a
MatrixObject. |
static org.apache.sysml.runtime.controlprogram.caching.MatrixObject |
MLContextConversionUtil.binaryBlocksToMatrixObject(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> binaryBlocks,
MatrixMetadata matrixMetadata)
Convert a
JavaPairRDD<MatrixIndexes, MatrixBlock> to a
MatrixObject. |
| Constructor and Description |
|---|
Matrix(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> binaryBlocks,
MatrixMetadata matrixMetadata)
Create a Matrix, specifying the SystemML binary-block matrix and its
metadata.
|
| Modifier and Type | Field and Description |
|---|---|
MatrixBlock |
SpoofOperator.SideInput.mdat |
| Modifier and Type | Method and Description |
|---|---|
MatrixBlock |
SpoofOuterProduct.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects,
MatrixBlock out) |
MatrixBlock |
SpoofMultiAggregate.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects,
MatrixBlock out) |
abstract MatrixBlock |
SpoofOperator.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalars,
MatrixBlock out) |
MatrixBlock |
SpoofRowwise.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects,
MatrixBlock out) |
MatrixBlock |
SpoofCellwise.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects,
MatrixBlock out) |
MatrixBlock |
SpoofRowwise.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects,
MatrixBlock out,
boolean allocTmp,
boolean aggIncr,
long rix) |
MatrixBlock |
SpoofOuterProduct.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects,
MatrixBlock out,
int numThreads) |
MatrixBlock |
SpoofMultiAggregate.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects,
MatrixBlock out,
int k) |
MatrixBlock |
SpoofOperator.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalars,
MatrixBlock out,
int k) |
MatrixBlock |
SpoofRowwise.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects,
MatrixBlock out,
int k) |
MatrixBlock |
SpoofCellwise.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects,
MatrixBlock out,
int k) |
MatrixBlock |
SpoofMultiAggregate.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects,
MatrixBlock out,
int k,
long rix) |
MatrixBlock |
SpoofCellwise.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects,
MatrixBlock out,
int k,
long rix) |
| Modifier and Type | Method and Description |
|---|---|
static void |
SpoofMultiAggregate.aggregatePartialResults(SpoofCellwise.AggOp[] aggOps,
MatrixBlock c,
MatrixBlock b) |
static SpoofOperator.SideInput |
CodegenUtils.createSideInput(MatrixBlock in) |
MatrixBlock |
SpoofOuterProduct.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects,
MatrixBlock out) |
MatrixBlock |
SpoofMultiAggregate.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects,
MatrixBlock out) |
abstract MatrixBlock |
SpoofOperator.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalars,
MatrixBlock out) |
MatrixBlock |
SpoofRowwise.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects,
MatrixBlock out) |
MatrixBlock |
SpoofCellwise.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects,
MatrixBlock out) |
MatrixBlock |
SpoofRowwise.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects,
MatrixBlock out,
boolean allocTmp,
boolean aggIncr,
long rix) |
MatrixBlock |
SpoofOuterProduct.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects,
MatrixBlock out,
int numThreads) |
MatrixBlock |
SpoofMultiAggregate.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects,
MatrixBlock out,
int k) |
MatrixBlock |
SpoofOperator.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalars,
MatrixBlock out,
int k) |
MatrixBlock |
SpoofRowwise.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects,
MatrixBlock out,
int k) |
MatrixBlock |
SpoofCellwise.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects,
MatrixBlock out,
int k) |
MatrixBlock |
SpoofMultiAggregate.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects,
MatrixBlock out,
int k,
long rix) |
MatrixBlock |
SpoofCellwise.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects,
MatrixBlock out,
int k,
long rix) |
| Modifier and Type | Method and Description |
|---|---|
org.apache.sysml.runtime.instructions.cp.ScalarObject |
SpoofOuterProduct.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects) |
org.apache.sysml.runtime.instructions.cp.ScalarObject |
SpoofOperator.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalars) |
org.apache.sysml.runtime.instructions.cp.ScalarObject |
SpoofOuterProduct.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects,
int numThreads) |
org.apache.sysml.runtime.instructions.cp.ScalarObject |
SpoofOperator.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalars,
int k) |
org.apache.sysml.runtime.instructions.cp.ScalarObject |
SpoofRowwise.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects,
int k) |
org.apache.sysml.runtime.instructions.cp.ScalarObject |
SpoofCellwise.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects,
int k) |
org.apache.sysml.runtime.instructions.cp.ScalarObject |
SpoofCellwise.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects,
int k,
long rix) |
MatrixBlock |
SpoofOuterProduct.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects,
MatrixBlock out) |
MatrixBlock |
SpoofMultiAggregate.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects,
MatrixBlock out) |
abstract MatrixBlock |
SpoofOperator.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalars,
MatrixBlock out) |
MatrixBlock |
SpoofRowwise.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects,
MatrixBlock out) |
MatrixBlock |
SpoofCellwise.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects,
MatrixBlock out) |
MatrixBlock |
SpoofRowwise.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects,
MatrixBlock out,
boolean allocTmp,
boolean aggIncr,
long rix) |
MatrixBlock |
SpoofOuterProduct.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects,
MatrixBlock out,
int numThreads) |
MatrixBlock |
SpoofMultiAggregate.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects,
MatrixBlock out,
int k) |
MatrixBlock |
SpoofOperator.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalars,
MatrixBlock out,
int k) |
MatrixBlock |
SpoofRowwise.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects,
MatrixBlock out,
int k) |
MatrixBlock |
SpoofCellwise.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects,
MatrixBlock out,
int k) |
MatrixBlock |
SpoofMultiAggregate.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects,
MatrixBlock out,
int k,
long rix) |
MatrixBlock |
SpoofCellwise.execute(ArrayList<MatrixBlock> inputs,
ArrayList<org.apache.sysml.runtime.instructions.cp.ScalarObject> scalarObjects,
MatrixBlock out,
int k,
long rix) |
static long |
SpoofOperator.getTotalInputNnz(ArrayList<MatrixBlock> inputs) |
static long |
SpoofOperator.getTotalInputSize(ArrayList<MatrixBlock> inputs) |
static boolean |
SpoofRowwise.hasMatrixSideInput(ArrayList<MatrixBlock> inputs) |
protected SpoofOperator.SideInput[] |
SpoofOperator.prepInputMatrices(ArrayList<MatrixBlock> inputs) |
protected SpoofOperator.SideInput[] |
SpoofOperator.prepInputMatrices(ArrayList<MatrixBlock> inputs,
boolean denseOnly) |
protected SpoofOperator.SideInput[] |
SpoofOperator.prepInputMatrices(ArrayList<MatrixBlock> inputs,
boolean denseOnly,
boolean tB1) |
protected SpoofOperator.SideInput[] |
SpoofOperator.prepInputMatrices(ArrayList<MatrixBlock> inputs,
int offset,
boolean denseOnly) |
protected SpoofOperator.SideInput[] |
SpoofOperator.prepInputMatrices(ArrayList<MatrixBlock> inputs,
int offset,
int len,
boolean denseOnly,
boolean tB1) |
| Constructor and Description |
|---|
SideInput(DenseBlock ddata,
MatrixBlock mdata,
int clength) |
| Modifier and Type | Class and Description |
|---|---|
class |
CompressedMatrixBlock
Experimental version of MatrixBlock that allows a compressed internal
representation.
|
| Modifier and Type | Field and Description |
|---|---|
protected MatrixBlock |
ReaderColumnSelectionDense._data |
protected MatrixBlock |
ReaderColumnSelectionDenseSample._data |
| Modifier and Type | Method and Description |
|---|---|
MatrixBlock |
CompressedMatrixBlock.aggregateBinaryOperations(MatrixBlock m1,
MatrixBlock m2,
MatrixBlock ret,
org.apache.sysml.runtime.matrix.operators.AggregateBinaryOperator op) |
MatrixBlock |
CompressedMatrixBlock.aggregateBinaryOperations(MatrixIndexes m1Index,
MatrixBlock m1Value,
MatrixIndexes m2Index,
MatrixBlock m2Value,
MatrixBlock result,
org.apache.sysml.runtime.matrix.operators.AggregateBinaryOperator op) |
MatrixBlock |
CompressedMatrixBlock.aggregateTernaryOperations(MatrixBlock m1,
MatrixBlock m2,
MatrixBlock m3,
MatrixBlock ret,
org.apache.sysml.runtime.matrix.operators.AggregateTernaryOperator op,
boolean inCP) |
MatrixBlock |
CompressedMatrixBlock.append(MatrixBlock that,
MatrixBlock ret) |
MatrixBlock |
CompressedMatrixBlock.append(MatrixBlock that,
MatrixBlock ret,
boolean cbind) |
MatrixBlock |
CompressedMatrixBlock.chainMatrixMultOperations(MatrixBlock v,
MatrixBlock w,
MatrixBlock out,
org.apache.sysml.lops.MapMultChain.ChainType ctype) |
MatrixBlock |
CompressedMatrixBlock.chainMatrixMultOperations(MatrixBlock v,
MatrixBlock w,
MatrixBlock out,
org.apache.sysml.lops.MapMultChain.ChainType ctype,
int k) |
MatrixBlock |
CompressedMatrixBlock.compress()
Compress the contents of this matrix block.
|
MatrixBlock |
CompressedMatrixBlock.compress(int k)
Compress block.
|
MatrixBlock |
CompressedMatrixBlock.ctableSeqOperations(MatrixValue that,
double scalar,
MatrixBlock resultBlock) |
MatrixBlock |
CompressedMatrixBlock.decompress()
Decompress block.
|
MatrixBlock |
CompressedMatrixBlock.decompress(int k)
Decompress block.
|
MatrixBlock |
ColGroupValue.getCountsAsBlock() |
static MatrixBlock |
ColGroupValue.getCountsAsBlock(int[] counts) |
MatrixBlock |
ColGroupUncompressed.getData()
Access for superclass
|
MatrixBlock |
ColGroupValue.getValuesAsBlock() |
MatrixBlock |
CompressedMatrixBlock.groupedAggOperations(MatrixValue tgt,
MatrixValue wghts,
MatrixValue ret,
int ngroups,
org.apache.sysml.runtime.matrix.operators.Operator op) |
MatrixBlock |
CompressedMatrixBlock.groupedAggOperations(MatrixValue tgt,
MatrixValue wghts,
MatrixValue ret,
int ngroups,
org.apache.sysml.runtime.matrix.operators.Operator op,
int k) |
MatrixBlock |
CompressedMatrixBlock.leftIndexingOperations(MatrixBlock rhsMatrix,
int rl,
int ru,
int cl,
int cu,
MatrixBlock ret,
org.apache.sysml.runtime.controlprogram.caching.MatrixObject.UpdateType update) |
MatrixBlock |
CompressedMatrixBlock.leftIndexingOperations(org.apache.sysml.runtime.instructions.cp.ScalarObject scalar,
int rl,
int cl,
MatrixBlock ret,
org.apache.sysml.runtime.controlprogram.caching.MatrixObject.UpdateType update) |
MatrixBlock |
CompressedMatrixBlock.quaternaryOperations(org.apache.sysml.runtime.matrix.operators.QuaternaryOperator qop,
MatrixBlock um,
MatrixBlock vm,
MatrixBlock wm,
MatrixBlock out) |
MatrixBlock |
CompressedMatrixBlock.quaternaryOperations(org.apache.sysml.runtime.matrix.operators.QuaternaryOperator qop,
MatrixBlock um,
MatrixBlock vm,
MatrixBlock wm,
MatrixBlock out,
int k) |
MatrixBlock |
CompressedMatrixBlock.randOperationsInPlace(RandomMatrixGenerator rgen,
org.apache.commons.math3.random.Well1024a bigrand,
long bSeed) |
MatrixBlock |
CompressedMatrixBlock.randOperationsInPlace(RandomMatrixGenerator rgen,
org.apache.commons.math3.random.Well1024a bigrand,
long bSeed,
int k) |
MatrixBlock |
CompressedMatrixBlock.removeEmptyOperations(MatrixBlock ret,
boolean rows,
boolean emptyReturn) |
MatrixBlock |
CompressedMatrixBlock.removeEmptyOperations(MatrixBlock ret,
boolean rows,
boolean emptyReturn,
MatrixBlock select) |
MatrixBlock |
CompressedMatrixBlock.rexpandOperations(MatrixBlock ret,
double max,
boolean rows,
boolean cast,
boolean ignore,
int k) |
MatrixBlock |
CompressedMatrixBlock.seqOperationsInPlace(double from,
double to,
double incr) |
MatrixBlock |
CompressedMatrixBlock.slice(int rl,
int ru,
int cl,
int cu,
org.apache.sysml.runtime.controlprogram.caching.CacheBlock ret) |
MatrixBlock |
CompressedMatrixBlock.ternaryOperations(org.apache.sysml.runtime.matrix.operators.TernaryOperator op,
MatrixBlock m2,
MatrixBlock m3,
MatrixBlock ret) |
MatrixBlock |
CompressedMatrixBlock.transposeSelfMatrixMultOperations(MatrixBlock out,
org.apache.sysml.lops.MMTSJ.MMTSJType tstype) |
MatrixBlock |
CompressedMatrixBlock.transposeSelfMatrixMultOperations(MatrixBlock out,
org.apache.sysml.lops.MMTSJ.MMTSJType tstype,
int k) |
MatrixBlock |
CompressedMatrixBlock.uaggouterchainOperations(MatrixBlock mbLeft,
MatrixBlock mbRight,
MatrixBlock mbOut,
org.apache.sysml.runtime.matrix.operators.BinaryOperator bOp,
org.apache.sysml.runtime.matrix.operators.AggregateUnaryOperator uaggOp) |
| Modifier and Type | Method and Description |
|---|---|
MatrixBlock |
CompressedMatrixBlock.aggregateBinaryOperations(MatrixBlock m1,
MatrixBlock m2,
MatrixBlock ret,
org.apache.sysml.runtime.matrix.operators.AggregateBinaryOperator op) |
MatrixBlock |
CompressedMatrixBlock.aggregateBinaryOperations(MatrixIndexes m1Index,
MatrixBlock m1Value,
MatrixIndexes m2Index,
MatrixBlock m2Value,
MatrixBlock result,
org.apache.sysml.runtime.matrix.operators.AggregateBinaryOperator op) |
MatrixBlock |
CompressedMatrixBlock.aggregateTernaryOperations(MatrixBlock m1,
MatrixBlock m2,
MatrixBlock m3,
MatrixBlock ret,
org.apache.sysml.runtime.matrix.operators.AggregateTernaryOperator op,
boolean inCP) |
MatrixBlock |
CompressedMatrixBlock.append(MatrixBlock that,
MatrixBlock ret) |
MatrixBlock |
CompressedMatrixBlock.append(MatrixBlock that,
MatrixBlock ret,
boolean cbind) |
MatrixBlock |
CompressedMatrixBlock.chainMatrixMultOperations(MatrixBlock v,
MatrixBlock w,
MatrixBlock out,
org.apache.sysml.lops.MapMultChain.ChainType ctype) |
MatrixBlock |
CompressedMatrixBlock.chainMatrixMultOperations(MatrixBlock v,
MatrixBlock w,
MatrixBlock out,
org.apache.sysml.lops.MapMultChain.ChainType ctype,
int k) |
org.apache.sysml.runtime.instructions.cp.CM_COV_Object |
CompressedMatrixBlock.cmOperations(org.apache.sysml.runtime.matrix.operators.CMOperator op,
MatrixBlock weights) |
protected void |
ColGroupValue.computeColMxx(MatrixBlock result,
org.apache.sysml.runtime.functionobjects.Builtin builtin,
boolean zeros)
NOTE: Shared across OLE/RLE/DDC because value-only computation.
|
protected abstract void |
ColGroupOffset.computeColSums(MatrixBlock result,
org.apache.sysml.runtime.functionobjects.KahanFunction kplus) |
protected void |
ColGroupOLE.computeColSums(MatrixBlock result,
org.apache.sysml.runtime.functionobjects.KahanFunction kplus) |
protected void |
ColGroupDDC.computeColSums(MatrixBlock result,
org.apache.sysml.runtime.functionobjects.KahanFunction kplus) |
protected void |
ColGroupRLE.computeColSums(MatrixBlock result,
org.apache.sysml.runtime.functionobjects.KahanFunction kplus) |
protected void |
ColGroupValue.computeMxx(MatrixBlock result,
org.apache.sysml.runtime.functionobjects.Builtin builtin,
boolean zeros)
NOTE: Shared across OLE/RLE/DDC because value-only computation.
|
protected abstract void |
ColGroupOffset.computeRowMxx(MatrixBlock result,
org.apache.sysml.runtime.functionobjects.Builtin builtin,
int rl,
int ru) |
protected void |
ColGroupOLE.computeRowMxx(MatrixBlock result,
org.apache.sysml.runtime.functionobjects.Builtin builtin,
int rl,
int ru) |
protected void |
ColGroupDDC.computeRowMxx(MatrixBlock result,
org.apache.sysml.runtime.functionobjects.Builtin builtin,
int rl,
int ru) |
protected void |
ColGroupRLE.computeRowMxx(MatrixBlock result,
org.apache.sysml.runtime.functionobjects.Builtin builtin,
int rl,
int ru) |
static void |
ColGroupDDC1.computeRowSums(ColGroupDDC1[] grps,
MatrixBlock result,
org.apache.sysml.runtime.functionobjects.KahanFunction kplus,
int rl,
int ru) |
protected abstract void |
ColGroupOffset.computeRowSums(MatrixBlock result,
org.apache.sysml.runtime.functionobjects.KahanFunction kplus,
int rl,
int ru) |
protected void |
ColGroupOLE.computeRowSums(MatrixBlock result,
org.apache.sysml.runtime.functionobjects.KahanFunction kplus,
int rl,
int ru) |
protected void |
ColGroupDDC2.computeRowSums(MatrixBlock result,
org.apache.sysml.runtime.functionobjects.KahanFunction kplus,
int rl,
int ru) |
protected void |
ColGroupDDC.computeRowSums(MatrixBlock result,
org.apache.sysml.runtime.functionobjects.KahanFunction kplus,
int rl,
int ru) |
protected void |
ColGroupDDC1.computeRowSums(MatrixBlock result,
org.apache.sysml.runtime.functionobjects.KahanFunction kplus,
int rl,
int ru) |
protected void |
ColGroupRLE.computeRowSums(MatrixBlock result,
org.apache.sysml.runtime.functionobjects.KahanFunction kplus,
int rl,
int ru) |
protected abstract void |
ColGroupOffset.computeSum(MatrixBlock result,
org.apache.sysml.runtime.functionobjects.KahanFunction kplus) |
protected void |
ColGroupOLE.computeSum(MatrixBlock result,
org.apache.sysml.runtime.functionobjects.KahanFunction kplus) |
protected void |
ColGroupDDC2.computeSum(MatrixBlock result,
org.apache.sysml.runtime.functionobjects.KahanFunction kplus) |
protected void |
ColGroupDDC.computeSum(MatrixBlock result,
org.apache.sysml.runtime.functionobjects.KahanFunction kplus) |
protected void |
ColGroupDDC1.computeSum(MatrixBlock result,
org.apache.sysml.runtime.functionobjects.KahanFunction kplus) |
protected void |
ColGroupRLE.computeSum(MatrixBlock result,
org.apache.sysml.runtime.functionobjects.KahanFunction kplus) |
org.apache.sysml.runtime.instructions.cp.CM_COV_Object |
CompressedMatrixBlock.covOperations(org.apache.sysml.runtime.matrix.operators.COVOperator op,
MatrixBlock that) |
org.apache.sysml.runtime.instructions.cp.CM_COV_Object |
CompressedMatrixBlock.covOperations(org.apache.sysml.runtime.matrix.operators.COVOperator op,
MatrixBlock that,
MatrixBlock weights) |
void |
CompressedMatrixBlock.ctableOperations(org.apache.sysml.runtime.matrix.operators.Operator op,
double scalar,
double scalar2,
CTableMap resultMap,
MatrixBlock resultBlock) |
void |
CompressedMatrixBlock.ctableOperations(org.apache.sysml.runtime.matrix.operators.Operator op,
double scalar,
MatrixValue that,
CTableMap resultMap,
MatrixBlock resultBlock) |
void |
CompressedMatrixBlock.ctableOperations(org.apache.sysml.runtime.matrix.operators.Operator op,
MatrixIndexes ix1,
double scalar,
boolean left,
int brlen,
CTableMap resultMap,
MatrixBlock resultBlock) |
void |
CompressedMatrixBlock.ctableOperations(org.apache.sysml.runtime.matrix.operators.Operator op,
MatrixValue that,
double scalar,
boolean ignoreZeros,
CTableMap resultMap,
MatrixBlock resultBlock) |
void |
CompressedMatrixBlock.ctableOperations(org.apache.sysml.runtime.matrix.operators.Operator op,
MatrixValue that,
MatrixValue that2,
CTableMap resultMap,
MatrixBlock resultBlock) |
MatrixBlock |
CompressedMatrixBlock.ctableSeqOperations(MatrixValue that,
double scalar,
MatrixBlock resultBlock) |
void |
ColGroupOffset.decompressToBlock(MatrixBlock target,
int colpos) |
void |
ColGroupOLE.decompressToBlock(MatrixBlock target,
int colpos) |
abstract void |
ColGroup.decompressToBlock(MatrixBlock target,
int colpos)
Decompress to block.
|
void |
ColGroupDDC2.decompressToBlock(MatrixBlock target,
int colpos) |
void |
ColGroupUncompressed.decompressToBlock(MatrixBlock target,
int colpos) |
void |
ColGroupDDC.decompressToBlock(MatrixBlock target,
int colpos) |
void |
ColGroupDDC1.decompressToBlock(MatrixBlock target,
int colpos) |
void |
ColGroupRLE.decompressToBlock(MatrixBlock target,
int colpos) |
void |
ColGroupOffset.decompressToBlock(MatrixBlock target,
int[] colIndexTargets) |
void |
ColGroupOLE.decompressToBlock(MatrixBlock target,
int[] colixTargets) |
abstract void |
ColGroup.decompressToBlock(MatrixBlock target,
int[] colIndexTargets)
Decompress the contents of this column group into uncompressed packed
columns
|
void |
ColGroupUncompressed.decompressToBlock(MatrixBlock target,
int[] colIndexTargets) |
void |
ColGroupDDC.decompressToBlock(MatrixBlock target,
int[] colIndexTargets) |
void |
ColGroupRLE.decompressToBlock(MatrixBlock target,
int[] colixTargets) |
void |
ColGroupOffset.decompressToBlock(MatrixBlock target,
int rl,
int ru) |
void |
ColGroupOLE.decompressToBlock(MatrixBlock target,
int rl,
int ru) |
abstract void |
ColGroup.decompressToBlock(MatrixBlock target,
int rl,
int ru)
Decompress the contents of this column group into the specified full
matrix block.
|
void |
ColGroupDDC2.decompressToBlock(MatrixBlock target,
int rl,
int ru) |
void |
ColGroupUncompressed.decompressToBlock(MatrixBlock target,
int rl,
int ru) |
void |
ColGroupDDC.decompressToBlock(MatrixBlock target,
int rl,
int ru) |
void |
ColGroupDDC1.decompressToBlock(MatrixBlock target,
int rl,
int ru) |
void |
ColGroupRLE.decompressToBlock(MatrixBlock target,
int rl,
int ru) |
static UncompressedBitmap |
BitmapEncoder.extractBitmap(int[] colIndices,
MatrixBlock rawblock)
Generate uncompressed bitmaps for a set of columns in an uncompressed
matrix block.
|
static UncompressedBitmap |
BitmapEncoder.extractBitmapFromSample(int[] colIndices,
MatrixBlock rawblock,
int[] sampleIndexes) |
MatrixBlock |
CompressedMatrixBlock.leftIndexingOperations(MatrixBlock rhsMatrix,
int rl,
int ru,
int cl,
int cu,
MatrixBlock ret,
org.apache.sysml.runtime.controlprogram.caching.MatrixObject.UpdateType update) |
MatrixBlock |
CompressedMatrixBlock.leftIndexingOperations(org.apache.sysml.runtime.instructions.cp.ScalarObject scalar,
int rl,
int cl,
MatrixBlock ret,
org.apache.sysml.runtime.controlprogram.caching.MatrixObject.UpdateType update) |
void |
ColGroupOLE.leftMultByRowVector(ColGroupDDC a,
MatrixBlock result) |
void |
ColGroupDDC2.leftMultByRowVector(ColGroupDDC a,
MatrixBlock result) |
abstract void |
ColGroupValue.leftMultByRowVector(ColGroupDDC vector,
MatrixBlock result) |
void |
ColGroupDDC1.leftMultByRowVector(ColGroupDDC a,
MatrixBlock result) |
void |
ColGroupRLE.leftMultByRowVector(ColGroupDDC a,
MatrixBlock result) |
void |
ColGroupOLE.leftMultByRowVector(MatrixBlock vector,
MatrixBlock result) |
abstract void |
ColGroup.leftMultByRowVector(MatrixBlock vector,
MatrixBlock result)
Multiply the slice of the matrix that this column group represents by a
row vector on the left (the original column vector is assumed to be
transposed already i.e.
|
void |
ColGroupDDC2.leftMultByRowVector(MatrixBlock vector,
MatrixBlock result) |
void |
ColGroupUncompressed.leftMultByRowVector(MatrixBlock vector,
MatrixBlock result) |
void |
ColGroupDDC1.leftMultByRowVector(MatrixBlock vector,
MatrixBlock result) |
void |
ColGroupRLE.leftMultByRowVector(MatrixBlock vector,
MatrixBlock result) |
void |
ColGroupUncompressed.leftMultByRowVector(MatrixBlock vector,
MatrixBlock result,
int k) |
MatrixBlock |
CompressedMatrixBlock.quaternaryOperations(org.apache.sysml.runtime.matrix.operators.QuaternaryOperator qop,
MatrixBlock um,
MatrixBlock vm,
MatrixBlock wm,
MatrixBlock out) |
MatrixBlock |
CompressedMatrixBlock.quaternaryOperations(org.apache.sysml.runtime.matrix.operators.QuaternaryOperator qop,
MatrixBlock um,
MatrixBlock vm,
MatrixBlock wm,
MatrixBlock out,
int k) |
MatrixBlock |
CompressedMatrixBlock.removeEmptyOperations(MatrixBlock ret,
boolean rows,
boolean emptyReturn) |
MatrixBlock |
CompressedMatrixBlock.removeEmptyOperations(MatrixBlock ret,
boolean rows,
boolean emptyReturn,
MatrixBlock select) |
MatrixBlock |
CompressedMatrixBlock.rexpandOperations(MatrixBlock ret,
double max,
boolean rows,
boolean cast,
boolean ignore,
int k) |
static void |
ColGroupDDC1.rightMultByVector(ColGroupDDC1[] grps,
MatrixBlock vector,
MatrixBlock result,
int rl,
int ru) |
void |
ColGroupUncompressed.rightMultByVector(MatrixBlock vector,
MatrixBlock result,
int k) |
void |
ColGroupOLE.rightMultByVector(MatrixBlock vector,
MatrixBlock result,
int rl,
int ru) |
abstract void |
ColGroup.rightMultByVector(MatrixBlock vector,
MatrixBlock result,
int rl,
int ru)
Multiply the slice of the matrix that this column group represents by a
vector on the right.
|
void |
ColGroupDDC2.rightMultByVector(MatrixBlock vector,
MatrixBlock result,
int rl,
int ru) |
void |
ColGroupUncompressed.rightMultByVector(MatrixBlock vector,
MatrixBlock result,
int rl,
int ru) |
void |
ColGroupDDC1.rightMultByVector(MatrixBlock vector,
MatrixBlock result,
int rl,
int ru) |
void |
ColGroupRLE.rightMultByVector(MatrixBlock vector,
MatrixBlock result,
int rl,
int ru) |
MatrixBlock |
CompressedMatrixBlock.ternaryOperations(org.apache.sysml.runtime.matrix.operators.TernaryOperator op,
MatrixBlock m2,
MatrixBlock m3,
MatrixBlock ret) |
MatrixBlock |
CompressedMatrixBlock.transposeSelfMatrixMultOperations(MatrixBlock out,
org.apache.sysml.lops.MMTSJ.MMTSJType tstype) |
MatrixBlock |
CompressedMatrixBlock.transposeSelfMatrixMultOperations(MatrixBlock out,
org.apache.sysml.lops.MMTSJ.MMTSJType tstype,
int k) |
MatrixBlock |
CompressedMatrixBlock.uaggouterchainOperations(MatrixBlock mbLeft,
MatrixBlock mbRight,
MatrixBlock mbOut,
org.apache.sysml.runtime.matrix.operators.BinaryOperator bOp,
org.apache.sysml.runtime.matrix.operators.AggregateUnaryOperator uaggOp) |
abstract void |
ColGroup.unaryAggregateOperations(org.apache.sysml.runtime.matrix.operators.AggregateUnaryOperator op,
MatrixBlock result) |
void |
ColGroupUncompressed.unaryAggregateOperations(org.apache.sysml.runtime.matrix.operators.AggregateUnaryOperator op,
MatrixBlock ret) |
void |
ColGroupValue.unaryAggregateOperations(org.apache.sysml.runtime.matrix.operators.AggregateUnaryOperator op,
MatrixBlock result) |
void |
ColGroupOffset.unaryAggregateOperations(org.apache.sysml.runtime.matrix.operators.AggregateUnaryOperator op,
MatrixBlock result,
int rl,
int ru) |
void |
ColGroupDDC.unaryAggregateOperations(org.apache.sysml.runtime.matrix.operators.AggregateUnaryOperator op,
MatrixBlock result,
int rl,
int ru) |
abstract void |
ColGroupValue.unaryAggregateOperations(org.apache.sysml.runtime.matrix.operators.AggregateUnaryOperator op,
MatrixBlock result,
int rl,
int ru) |
| Constructor and Description |
|---|
ColGroupUncompressed(int[] colIndices,
int numRows,
MatrixBlock data)
Constructor for internal use.
|
ColGroupUncompressed(List<Integer> colIndicesList,
MatrixBlock rawblock)
Main constructor.
|
CompressedMatrixBlock(MatrixBlock mb)
"Copy" constructor to populate this compressed block with the
uncompressed contents of a conventional block.
|
ReaderColumnSelectionDense(MatrixBlock data,
int[] colIndices,
boolean skipZeros) |
ReaderColumnSelectionDenseSample(MatrixBlock data,
int[] colIndexes,
int[] sampleIndexes,
boolean skipZeros) |
ReaderColumnSelectionSparse(MatrixBlock data,
int[] colIndexes,
boolean skipZeros) |
| Modifier and Type | Field and Description |
|---|---|
protected MatrixBlock |
CompressedSizeEstimator._data |
| Modifier and Type | Method and Description |
|---|---|
static CompressedSizeEstimator |
SizeEstimatorFactory.getSizeEstimator(MatrixBlock data,
int numRows) |
| Constructor and Description |
|---|
CompressedSizeEstimator(MatrixBlock data) |
CompressedSizeEstimatorExact(MatrixBlock data) |
CompressedSizeEstimatorSample(MatrixBlock data,
int sampleSize) |
| Modifier and Type | Method and Description |
|---|---|
static MatrixBlock |
ConverterUtils.getUncompressedColBlock(ColGroup group) |
| Modifier and Type | Method and Description |
|---|---|
static void |
LinearAlgebraUtils.copyNonZerosToUpperTriangle(MatrixBlock ret,
MatrixBlock tmp,
int ix) |
static long |
LinearAlgebraUtils.copyUpperToLowerTriangle(MatrixBlock ret) |
static double[] |
ConverterUtils.getDenseVector(MatrixBlock vector) |
| Modifier and Type | Method and Description |
|---|---|
MatrixBlock |
CompressionSPInstruction.CompressionFunction.call(MatrixBlock arg0) |
MatrixBlock |
ParameterizedBuiltinSPInstruction.RDDReplaceFunction.call(MatrixBlock arg0) |
MatrixBlock[] |
CtableSPInstruction.MapJoinSignature1.call(MatrixBlock v1) |
MatrixBlock |
BinUaggChainSPInstruction.RDDBinUaggChainFunction.call(MatrixBlock arg0) |
MatrixBlock[] |
CtableSPInstruction.MapJoinSignature2.call(scala.Tuple2<MatrixBlock,MatrixBlock> v1) |
MatrixBlock |
AggregateUnarySPInstruction.RDDUAggFunction2.call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0) |
MatrixBlock |
ParameterizedBuiltinSPInstruction.RDDMapGroupedAggFunction2.call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0) |
MatrixBlock[] |
CtableSPInstruction.MapJoinSignature3.call(scala.Tuple2<scala.Tuple2<MatrixBlock,MatrixBlock>,MatrixBlock> v1) |
static MatrixBlock |
MatrixIndexingSPInstruction.inmemoryIndexing(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in1,
MatrixCharacteristics mcIn,
MatrixCharacteristics mcOut,
org.apache.sysml.runtime.util.IndexRange ixrange) |
| Modifier and Type | Method and Description |
|---|---|
scala.Tuple2<MatrixIndexes,MatrixBlock> |
BuiltinNarySPInstruction.PadBlocksFunction.call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0) |
Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>> |
AppendGSPInstruction.ShiftMatrix.call(scala.Tuple2<MatrixIndexes,MatrixBlock> kv) |
scala.Tuple2<MatrixIndexes,MatrixBlock> |
AppendGAlignedSPInstruction.ShiftColumnIndex.call(scala.Tuple2<MatrixIndexes,MatrixBlock> kv) |
Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>> |
SpoofSPInstruction.ReplicateRightFactorFunction.call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0) |
Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>> |
ParameterizedBuiltinSPInstruction.RDDRemoveEmptyFunctionInMem.call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0) |
Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>> |
ParameterizedBuiltinSPInstruction.RDDRExpandFunction.call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0) |
Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>> |
ParameterizedBuiltinSPInstruction.RDDMapGroupedAggFunction.call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0) |
scala.Tuple2<MatrixIndexes,MatrixBlock> |
ParameterizedBuiltinSPInstruction.RDDTransformDecodeExpandFunction.call(scala.Tuple2<MatrixIndexes,MatrixBlock> in) |
scala.Tuple2<MatrixIndexes,MatrixBlock> |
AppendGSPInstruction.MergeWithShiftedBlocks.call(scala.Tuple2<MatrixIndexes,scala.Tuple2<Iterable<MatrixBlock>,Iterable<MatrixBlock>>> kv) |
Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>> |
ParameterizedBuiltinSPInstruction.RDDRemoveEmptyFunction.call(scala.Tuple2<MatrixIndexes,scala.Tuple2<MatrixBlock,MatrixBlock>> arg0) |
protected org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
CSVReblockSPInstruction.processMatrixCSVReblockInstruction(org.apache.sysml.runtime.controlprogram.context.SparkExecutionContext sec,
MatrixCharacteristics mcOut) |
| Modifier and Type | Method and Description |
|---|---|
MatrixBlock |
CompressionSPInstruction.CompressionFunction.call(MatrixBlock arg0) |
MatrixBlock |
ParameterizedBuiltinSPInstruction.RDDReplaceFunction.call(MatrixBlock arg0) |
MatrixBlock[] |
CtableSPInstruction.MapJoinSignature1.call(MatrixBlock v1) |
MatrixBlock |
BinUaggChainSPInstruction.RDDBinUaggChainFunction.call(MatrixBlock arg0) |
| Modifier and Type | Method and Description |
|---|---|
MatrixBlock[] |
CtableSPInstruction.MapJoinSignature2.call(scala.Tuple2<MatrixBlock,MatrixBlock> v1) |
MatrixBlock[] |
CtableSPInstruction.MapJoinSignature2.call(scala.Tuple2<MatrixBlock,MatrixBlock> v1) |
scala.Tuple2<MatrixIndexes,MatrixBlock> |
BuiltinNarySPInstruction.PadBlocksFunction.call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0) |
MatrixBlock |
AggregateUnarySPInstruction.RDDUAggFunction2.call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0) |
Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>> |
AppendGSPInstruction.ShiftMatrix.call(scala.Tuple2<MatrixIndexes,MatrixBlock> kv) |
scala.Tuple2<MatrixIndexes,MatrixBlock> |
AppendGAlignedSPInstruction.ShiftColumnIndex.call(scala.Tuple2<MatrixIndexes,MatrixBlock> kv) |
Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>> |
SpoofSPInstruction.ReplicateRightFactorFunction.call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0) |
Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>> |
ParameterizedBuiltinSPInstruction.RDDRemoveEmptyFunctionInMem.call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0) |
Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>> |
ParameterizedBuiltinSPInstruction.RDDRExpandFunction.call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0) |
Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>> |
ParameterizedBuiltinSPInstruction.RDDMapGroupedAggFunction.call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0) |
MatrixBlock |
ParameterizedBuiltinSPInstruction.RDDMapGroupedAggFunction2.call(scala.Tuple2<MatrixIndexes,MatrixBlock> arg0) |
scala.Tuple2<Long,FrameBlock> |
ParameterizedBuiltinSPInstruction.RDDTransformDecodeFunction.call(scala.Tuple2<MatrixIndexes,MatrixBlock> in) |
scala.Tuple2<MatrixIndexes,MatrixBlock> |
ParameterizedBuiltinSPInstruction.RDDTransformDecodeExpandFunction.call(scala.Tuple2<MatrixIndexes,MatrixBlock> in) |
scala.Tuple2<MatrixIndexes,MatrixBlock> |
AppendGSPInstruction.MergeWithShiftedBlocks.call(scala.Tuple2<MatrixIndexes,scala.Tuple2<Iterable<MatrixBlock>,Iterable<MatrixBlock>>> kv) |
scala.Tuple2<MatrixIndexes,MatrixBlock> |
AppendGSPInstruction.MergeWithShiftedBlocks.call(scala.Tuple2<MatrixIndexes,scala.Tuple2<Iterable<MatrixBlock>,Iterable<MatrixBlock>>> kv) |
Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>> |
ParameterizedBuiltinSPInstruction.RDDRemoveEmptyFunction.call(scala.Tuple2<MatrixIndexes,scala.Tuple2<MatrixBlock,MatrixBlock>> arg0) |
Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>> |
ParameterizedBuiltinSPInstruction.RDDRemoveEmptyFunction.call(scala.Tuple2<MatrixIndexes,scala.Tuple2<MatrixBlock,MatrixBlock>> arg0) |
MatrixBlock[] |
CtableSPInstruction.MapJoinSignature3.call(scala.Tuple2<scala.Tuple2<MatrixBlock,MatrixBlock>,MatrixBlock> v1) |
MatrixBlock[] |
CtableSPInstruction.MapJoinSignature3.call(scala.Tuple2<scala.Tuple2<MatrixBlock,MatrixBlock>,MatrixBlock> v1) |
MatrixBlock[] |
CtableSPInstruction.MapJoinSignature3.call(scala.Tuple2<scala.Tuple2<MatrixBlock,MatrixBlock>,MatrixBlock> v1) |
static MatrixBlock |
MatrixIndexingSPInstruction.inmemoryIndexing(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in1,
MatrixCharacteristics mcIn,
MatrixCharacteristics mcOut,
org.apache.sysml.runtime.util.IndexRange ixrange) |
| Constructor and Description |
|---|
RDDMapGroupedAggFunction(org.apache.sysml.runtime.instructions.spark.data.PartitionedBroadcast<MatrixBlock> pbm,
org.apache.sysml.runtime.matrix.operators.Operator op,
int ngroups,
int brlen,
int bclen) |
RDDMapGroupedAggFunction2(org.apache.sysml.runtime.instructions.spark.data.PartitionedBroadcast<MatrixBlock> pbm,
org.apache.sysml.runtime.matrix.operators.Operator op,
int ngroups) |
RDDRemoveEmptyFunctionInMem(boolean rmRows,
long len,
long brlen,
long bclen,
org.apache.sysml.runtime.instructions.spark.data.PartitionedBroadcast<MatrixBlock> off) |
| Modifier and Type | Method and Description |
|---|---|
static MatrixBlock |
RDDAggregateUtils.aggStable(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in,
org.apache.sysml.runtime.matrix.operators.AggregateOperator aop)
Single block aggregation over pair rdds with corrections for numerical stability.
|
static MatrixBlock |
RDDAggregateUtils.aggStable(org.apache.spark.api.java.JavaRDD<MatrixBlock> in,
org.apache.sysml.runtime.matrix.operators.AggregateOperator aop)
Single block aggregation over rdds with corrections for numerical stability.
|
static MatrixBlock |
RDDConverterUtilsExt.allocateDenseOrSparse(int rlen,
int clen,
boolean isSparse) |
static MatrixBlock |
RDDConverterUtilsExt.allocateDenseOrSparse(long rlen,
long clen,
boolean isSparse) |
static MatrixBlock |
RDDConverterUtilsExt.convertPy4JArrayToMB(byte[] data,
int rlen,
int clen) |
static MatrixBlock |
RDDConverterUtilsExt.convertPy4JArrayToMB(byte[] data,
int rlen,
int clen,
boolean isSparse) |
static MatrixBlock |
RDDConverterUtilsExt.convertPy4JArrayToMB(byte[] data,
long rlen,
long clen) |
static MatrixBlock |
RDDConverterUtilsExt.convertPy4JArrayToMB(byte[] data,
long rlen,
long clen,
boolean isSparse) |
static MatrixBlock |
RDDConverterUtilsExt.convertSciPyCOOToMB(byte[] data,
byte[] row,
byte[] col,
int rlen,
int clen,
int nnz) |
static MatrixBlock |
RDDConverterUtilsExt.convertSciPyCOOToMB(byte[] data,
byte[] row,
byte[] col,
long rlen,
long clen,
long nnz) |
static MatrixBlock |
RDDAggregateUtils.sumStable(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in) |
static MatrixBlock |
RDDAggregateUtils.sumStable(org.apache.spark.api.java.JavaRDD<MatrixBlock> in) |
| Modifier and Type | Method and Description |
|---|---|
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDAggregateUtils.aggByKeyStable(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in,
org.apache.sysml.runtime.matrix.operators.AggregateOperator aop) |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDAggregateUtils.aggByKeyStable(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in,
org.apache.sysml.runtime.matrix.operators.AggregateOperator aop,
boolean deepCopyCombiner) |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDAggregateUtils.aggByKeyStable(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in,
org.apache.sysml.runtime.matrix.operators.AggregateOperator aop,
int numPartitions,
boolean deepCopyCombiner) |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
FrameRDDConverterUtils.binaryBlockToMatrixBlock(org.apache.spark.api.java.JavaPairRDD<Long,FrameBlock> input,
MatrixCharacteristics mcIn,
MatrixCharacteristics mcOut) |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDConverterUtils.binaryCellToBinaryBlock(org.apache.spark.api.java.JavaSparkContext sc,
org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixCell> input,
MatrixCharacteristics mcOut,
boolean outputEmptyBlocks) |
Iterator<scala.Tuple2<MatrixIndexes,MatrixBlock>> |
RDDConverterUtils.BinaryCellToBinaryBlockFunction.call(Iterator<scala.Tuple2<MatrixIndexes,MatrixCell>> arg0) |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDConverterUtilsExt.coordinateMatrixToBinaryBlock(org.apache.spark.api.java.JavaSparkContext sc,
org.apache.spark.mllib.linalg.distributed.CoordinateMatrix input,
MatrixCharacteristics mcIn,
boolean outputEmptyBlocks)
Example usage:
|
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDConverterUtilsExt.coordinateMatrixToBinaryBlock(org.apache.spark.SparkContext sc,
org.apache.spark.mllib.linalg.distributed.CoordinateMatrix input,
MatrixCharacteristics mcIn,
boolean outputEmptyBlocks) |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
SparkUtils.copyBinaryBlockMatrix(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in)
Creates a partitioning-preserving deep copy of the input matrix RDD, where
the indexes and values are copied.
|
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
SparkUtils.copyBinaryBlockMatrix(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in,
boolean deep)
Creates a partitioning-preserving copy of the input matrix RDD.
|
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDConverterUtils.csvToBinaryBlock(org.apache.spark.api.java.JavaSparkContext sc,
org.apache.spark.api.java.JavaPairRDD<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text> input,
MatrixCharacteristics mc,
boolean hasHeader,
String delim,
boolean fill,
double fillValue) |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDConverterUtils.csvToBinaryBlock(org.apache.spark.api.java.JavaSparkContext sc,
org.apache.spark.api.java.JavaRDD<String> input,
MatrixCharacteristics mcOut,
boolean hasHeader,
String delim,
boolean fill,
double fillValue)
Example usage:
|
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDConverterUtils.dataFrameToBinaryBlock(org.apache.spark.api.java.JavaSparkContext sc,
org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> df,
MatrixCharacteristics mc,
boolean containsID,
boolean isVector) |
static scala.Tuple2<MatrixIndexes,MatrixBlock> |
SparkUtils.fromIndexedMatrixBlock(org.apache.sysml.runtime.matrix.mapred.IndexedMatrixValue in) |
static List<scala.Tuple2<MatrixIndexes,MatrixBlock>> |
SparkUtils.fromIndexedMatrixBlock(List<org.apache.sysml.runtime.matrix.mapred.IndexedMatrixValue> in) |
static Pair<MatrixIndexes,MatrixBlock> |
SparkUtils.fromIndexedMatrixBlockToPair(org.apache.sysml.runtime.matrix.mapred.IndexedMatrixValue in) |
static List<Pair<MatrixIndexes,MatrixBlock>> |
SparkUtils.fromIndexedMatrixBlockToPair(List<org.apache.sysml.runtime.matrix.mapred.IndexedMatrixValue> in) |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
SparkUtils.getEmptyBlockRDD(org.apache.spark.api.java.JavaSparkContext sc,
MatrixCharacteristics mc)
Creates an RDD of empty blocks according to the given matrix characteristics.
|
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDAggregateUtils.mergeByKey(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in)
Merges disjoint data of all blocks per key.
|
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDAggregateUtils.mergeByKey(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in,
boolean deepCopyCombiner)
Merges disjoint data of all blocks per key.
|
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDAggregateUtils.mergeByKey(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in,
int numPartitions,
boolean deepCopyCombiner)
Merges disjoint data of all blocks per key.
|
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDAggregateUtils.mergeRowsByKey(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,org.apache.sysml.runtime.instructions.spark.data.RowMatrixBlock> in)
Merges disjoint data of all blocks per key.
|
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDSortUtils.sortByVal(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in,
org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in2,
long rlen,
int brlen) |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDSortUtils.sortByVal(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in,
long rlen,
int brlen) |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDSortUtils.sortByVals(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in,
long rlen,
long clen,
int brlen) |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDSortUtils.sortDataByIx(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> data,
org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> ixmap,
long rlen,
long clen,
int brlen,
int bclen) |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDSortUtils.sortDataByVal(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> val,
org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> data,
boolean asc,
long rlen,
long clen,
int brlen,
int bclen) |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDSortUtils.sortDataByValMemSort(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> val,
org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> data,
boolean asc,
long rlen,
long clen,
int brlen,
int bclen,
org.apache.sysml.runtime.controlprogram.context.SparkExecutionContext sec,
org.apache.sysml.runtime.matrix.operators.ReorgOperator r_op)
This function collects and sorts value column in memory and then broadcasts it.
|
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDSortUtils.sortDataByVals(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> val,
org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> data,
boolean asc,
long rlen,
long clen,
long clen2,
int brlen,
int bclen) |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDSortUtils.sortIndexesByVal(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> val,
boolean asc,
long rlen,
int brlen) |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDSortUtils.sortIndexesByVals(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in,
boolean asc,
long rlen,
long clen,
int brlen) |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDAggregateUtils.sumByKeyStable(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in) |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDAggregateUtils.sumByKeyStable(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in,
boolean deepCopyCombiner) |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDAggregateUtils.sumByKeyStable(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in,
int numPartitions,
boolean deepCopyCombiner) |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDConverterUtils.textCellToBinaryBlock(org.apache.spark.api.java.JavaSparkContext sc,
org.apache.spark.api.java.JavaPairRDD<org.apache.hadoop.io.LongWritable,org.apache.hadoop.io.Text> input,
MatrixCharacteristics mcOut,
boolean outputEmptyBlocks,
org.apache.sysml.runtime.io.FileFormatPropertiesMM mmProps) |
| Modifier and Type | Method and Description |
|---|---|
static byte[] |
RDDConverterUtilsExt.convertMBtoPy4JDenseArr(MatrixBlock mb) |
static void |
RDDConverterUtilsExt.copyRowBlocks(MatrixBlock mb,
int rowIndex,
MatrixBlock ret,
int numRowsPerBlock,
int rlen,
int clen) |
static void |
RDDConverterUtilsExt.copyRowBlocks(MatrixBlock mb,
int rowIndex,
MatrixBlock ret,
long numRowsPerBlock,
long rlen,
long clen) |
static void |
RDDConverterUtilsExt.copyRowBlocks(MatrixBlock mb,
long rowIndex,
MatrixBlock ret,
int numRowsPerBlock,
int rlen,
int clen) |
static void |
RDDConverterUtilsExt.copyRowBlocks(MatrixBlock mb,
long rowIndex,
MatrixBlock ret,
long numRowsPerBlock,
long rlen,
long clen) |
static void |
RDDConverterUtilsExt.postProcessAfterCopying(MatrixBlock ret) |
static org.apache.sysml.runtime.matrix.mapred.IndexedMatrixValue |
SparkUtils.toIndexedMatrixBlock(MatrixIndexes ix,
MatrixBlock mb) |
| Modifier and Type | Method and Description |
|---|---|
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDAggregateUtils.aggByKeyStable(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in,
org.apache.sysml.runtime.matrix.operators.AggregateOperator aop) |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDAggregateUtils.aggByKeyStable(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in,
org.apache.sysml.runtime.matrix.operators.AggregateOperator aop,
boolean deepCopyCombiner) |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDAggregateUtils.aggByKeyStable(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in,
org.apache.sysml.runtime.matrix.operators.AggregateOperator aop,
int numPartitions,
boolean deepCopyCombiner) |
static MatrixBlock |
RDDAggregateUtils.aggStable(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in,
org.apache.sysml.runtime.matrix.operators.AggregateOperator aop)
Single block aggregation over pair rdds with corrections for numerical stability.
|
static MatrixBlock |
RDDAggregateUtils.aggStable(org.apache.spark.api.java.JavaRDD<MatrixBlock> in,
org.apache.sysml.runtime.matrix.operators.AggregateOperator aop)
Single block aggregation over rdds with corrections for numerical stability.
|
static org.apache.spark.api.java.JavaRDD<String> |
RDDConverterUtils.binaryBlockToCsv(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in,
MatrixCharacteristics mcIn,
org.apache.sysml.runtime.io.FileFormatPropertiesCSV props,
boolean strict) |
static org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> |
RDDConverterUtils.binaryBlockToDataFrame(org.apache.spark.sql.SparkSession sparkSession,
org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in,
MatrixCharacteristics mc,
boolean toVector) |
static org.apache.spark.sql.Dataset<org.apache.spark.sql.Row> |
RDDConverterUtils.binaryBlockToDataFrame(org.apache.spark.sql.SQLContext sqlContext,
org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in,
MatrixCharacteristics mc,
boolean toVector)
Deprecated.
|
static org.apache.spark.api.java.JavaRDD<org.apache.spark.ml.feature.LabeledPoint> |
RDDConverterUtils.binaryBlockToLabeledPoints(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in)
Converter from binary block rdd to rdd of labeled points.
|
static org.apache.spark.api.java.JavaRDD<String> |
RDDConverterUtils.binaryBlockToTextCell(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in,
MatrixCharacteristics mc) |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
SparkUtils.copyBinaryBlockMatrix(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in)
Creates a partitioning-preserving deep copy of the input matrix RDD, where
the indexes and values are copied.
|
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
SparkUtils.copyBinaryBlockMatrix(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in,
boolean deep)
Creates a partitioning-preserving copy of the input matrix RDD.
|
static long |
SparkUtils.getNonZeros(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> input) |
static org.apache.spark.api.java.JavaPairRDD<org.apache.hadoop.io.LongWritable,FrameBlock> |
FrameRDDConverterUtils.matrixBlockToBinaryBlock(org.apache.spark.api.java.JavaSparkContext sc,
org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> input,
MatrixCharacteristics mcIn) |
static org.apache.spark.api.java.JavaPairRDD<Long,FrameBlock> |
FrameRDDConverterUtils.matrixBlockToBinaryBlockLongIndex(org.apache.spark.api.java.JavaSparkContext sc,
org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> input,
MatrixCharacteristics mcIn) |
static double |
RDDAggregateUtils.max(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in) |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDAggregateUtils.mergeByKey(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in)
Merges disjoint data of all blocks per key.
|
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDAggregateUtils.mergeByKey(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in,
boolean deepCopyCombiner)
Merges disjoint data of all blocks per key.
|
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDAggregateUtils.mergeByKey(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in,
int numPartitions,
boolean deepCopyCombiner)
Merges disjoint data of all blocks per key.
|
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDSortUtils.sortByVal(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in,
org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in2,
long rlen,
int brlen) |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDSortUtils.sortByVal(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in,
org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in2,
long rlen,
int brlen) |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDSortUtils.sortByVal(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in,
long rlen,
int brlen) |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDSortUtils.sortByVals(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in,
long rlen,
long clen,
int brlen) |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDSortUtils.sortDataByIx(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> data,
org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> ixmap,
long rlen,
long clen,
int brlen,
int bclen) |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDSortUtils.sortDataByIx(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> data,
org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> ixmap,
long rlen,
long clen,
int brlen,
int bclen) |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDSortUtils.sortDataByVal(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> val,
org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> data,
boolean asc,
long rlen,
long clen,
int brlen,
int bclen) |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDSortUtils.sortDataByVal(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> val,
org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> data,
boolean asc,
long rlen,
long clen,
int brlen,
int bclen) |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDSortUtils.sortDataByValMemSort(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> val,
org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> data,
boolean asc,
long rlen,
long clen,
int brlen,
int bclen,
org.apache.sysml.runtime.controlprogram.context.SparkExecutionContext sec,
org.apache.sysml.runtime.matrix.operators.ReorgOperator r_op)
This function collects and sorts value column in memory and then broadcasts it.
|
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDSortUtils.sortDataByValMemSort(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> val,
org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> data,
boolean asc,
long rlen,
long clen,
int brlen,
int bclen,
org.apache.sysml.runtime.controlprogram.context.SparkExecutionContext sec,
org.apache.sysml.runtime.matrix.operators.ReorgOperator r_op)
This function collects and sorts value column in memory and then broadcasts it.
|
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDSortUtils.sortDataByVals(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> val,
org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> data,
boolean asc,
long rlen,
long clen,
long clen2,
int brlen,
int bclen) |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDSortUtils.sortDataByVals(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> val,
org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> data,
boolean asc,
long rlen,
long clen,
long clen2,
int brlen,
int bclen) |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDSortUtils.sortIndexesByVal(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> val,
boolean asc,
long rlen,
int brlen) |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDSortUtils.sortIndexesByVals(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in,
boolean asc,
long rlen,
long clen,
int brlen) |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDAggregateUtils.sumByKeyStable(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in) |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDAggregateUtils.sumByKeyStable(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in,
boolean deepCopyCombiner) |
static org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> |
RDDAggregateUtils.sumByKeyStable(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in,
int numPartitions,
boolean deepCopyCombiner) |
static MatrixBlock |
RDDAggregateUtils.sumStable(org.apache.spark.api.java.JavaPairRDD<MatrixIndexes,MatrixBlock> in) |
static MatrixBlock |
RDDAggregateUtils.sumStable(org.apache.spark.api.java.JavaRDD<MatrixBlock> in) |
static org.apache.sysml.runtime.matrix.mapred.IndexedMatrixValue |
SparkUtils.toIndexedMatrixBlock(scala.Tuple2<MatrixIndexes,MatrixBlock> in) |
| Modifier and Type | Field and Description |
|---|---|
MatrixBlock |
CSVReblockMR.BlockRow.data |
| Modifier and Type | Field and Description |
|---|---|
MatrixBlock |
DnnParameters.bias |
MatrixBlock |
DnnParameters.input1 |
MatrixBlock |
DnnParameters.input2 |
MatrixBlock |
DnnParameters.output |
| Modifier and Type | Method and Description |
|---|---|
MatrixBlock |
MatrixBlock.aggregateBinaryOperations(MatrixBlock m1,
MatrixBlock m2,
MatrixBlock ret,
org.apache.sysml.runtime.matrix.operators.AggregateBinaryOperator op) |
MatrixBlock |
MatrixBlock.aggregateBinaryOperations(MatrixIndexes m1Index,
MatrixBlock m1,
MatrixIndexes m2Index,
MatrixBlock m2,
MatrixBlock ret,
org.apache.sysml.runtime.matrix.operators.AggregateBinaryOperator op) |
static MatrixBlock |
LibMatrixAgg.aggregateTernary(MatrixBlock in1,
MatrixBlock in2,
MatrixBlock in3,
MatrixBlock ret,
org.apache.sysml.runtime.matrix.operators.AggregateTernaryOperator op) |
static MatrixBlock |
LibMatrixAgg.aggregateTernary(MatrixBlock in1,
MatrixBlock in2,
MatrixBlock in3,
MatrixBlock ret,
org.apache.sysml.runtime.matrix.operators.AggregateTernaryOperator op,
int k) |
MatrixBlock |
MatrixBlock.aggregateTernaryOperations(MatrixBlock m1,
MatrixBlock m2,
MatrixBlock m3,
MatrixBlock ret,
org.apache.sysml.runtime.matrix.operators.AggregateTernaryOperator op,
boolean inCP) |
MatrixBlock |
MatrixBlock.allocateBlock() |
MatrixBlock |
MatrixBlock.allocateDenseBlock() |
MatrixBlock |
MatrixBlock.append(MatrixBlock[] that,
MatrixBlock ret,
boolean cbind) |
MatrixBlock |
MatrixBlock.append(MatrixBlock that,
MatrixBlock ret) |
MatrixBlock |
MatrixBlock.append(MatrixBlock that,
MatrixBlock ret,
boolean cbind) |
MatrixBlock |
MatrixBlock.chainMatrixMultOperations(MatrixBlock v,
MatrixBlock w,
MatrixBlock out,
org.apache.sysml.lops.MapMultChain.ChainType ctype) |
MatrixBlock |
MatrixBlock.chainMatrixMultOperations(MatrixBlock v,
MatrixBlock w,
MatrixBlock out,
org.apache.sysml.lops.MapMultChain.ChainType ctype,
int k) |
MatrixBlock |
MatrixBlock.copyShallow(MatrixBlock that) |
MatrixBlock |
MatrixBlock.ctableSeqOperations(MatrixValue thatMatrix,
double thatScalar,
MatrixBlock resultBlock)
D = ctable(seq,A,w)
this <- seq; thatMatrix <- A; thatScalar <- w; result <- D
(i1,j1,v1) from input1 (this)
(i1,j1,v2) from input2 (that)
(w) from scalar_input3 (scalarThat2)
|
static MatrixBlock |
LibMatrixAgg.cumaggregateUnaryMatrix(MatrixBlock in,
MatrixBlock out,
org.apache.sysml.runtime.matrix.operators.UnaryOperator uop) |
static MatrixBlock |
LibMatrixAgg.cumaggregateUnaryMatrix(MatrixBlock in,
MatrixBlock out,
org.apache.sysml.runtime.matrix.operators.UnaryOperator uop,
int k) |
static MatrixBlock |
LibMatrixReorg.diag(MatrixBlock in,
MatrixBlock out) |
MatrixBlock |
MatrixBlock.extractTriangular(MatrixBlock ret,
boolean lower,
boolean diag,
boolean values) |
MatrixBlock |
AdaptivePartialBlock.getMatrixBlock() |
MatrixBlock |
MatrixBlock.groupedAggOperations(MatrixValue tgt,
MatrixValue wghts,
MatrixValue ret,
int ngroups,
org.apache.sysml.runtime.matrix.operators.Operator op)
Invocation from CP instructions.
|
MatrixBlock |
MatrixBlock.groupedAggOperations(MatrixValue tgt,
MatrixValue wghts,
MatrixValue ret,
int ngroups,
org.apache.sysml.runtime.matrix.operators.Operator op,
int k) |
MatrixBlock |
MatrixBlock.leftIndexingOperations(MatrixBlock rhsMatrix,
org.apache.sysml.runtime.util.IndexRange ixrange,
MatrixBlock ret,
org.apache.sysml.runtime.controlprogram.caching.MatrixObject.UpdateType update) |
MatrixBlock |
MatrixBlock.leftIndexingOperations(MatrixBlock rhsMatrix,
int rl,
int ru,
int cl,
int cu,
MatrixBlock ret,
org.apache.sysml.runtime.controlprogram.caching.MatrixObject.UpdateType update) |
MatrixBlock |
MatrixBlock.leftIndexingOperations(org.apache.sysml.runtime.instructions.cp.ScalarObject scalar,
int rl,
int cl,
MatrixBlock ret,
org.apache.sysml.runtime.controlprogram.caching.MatrixObject.UpdateType update)
Explicitly allow left indexing for scalars.
|
static MatrixBlock |
OperationsOnMatrixValues.matMult(MatrixBlock value1,
MatrixBlock value2,
MatrixBlock valueOut,
org.apache.sysml.runtime.matrix.operators.AggregateBinaryOperator op) |
static MatrixBlock |
OperationsOnMatrixValues.matMult(MatrixIndexes indexes1,
MatrixBlock value1,
MatrixIndexes indexes2,
MatrixBlock value2,
MatrixIndexes indexesOut,
MatrixBlock valueOut,
org.apache.sysml.runtime.matrix.operators.AggregateBinaryOperator op) |
static MatrixBlock |
LibCommonsMath.matrixMatrixOperations(MatrixBlock in1,
MatrixBlock in2,
String opcode) |
static MatrixBlock[] |
LibCommonsMath.multiReturnOperations(MatrixBlock in,
String opcode) |
static MatrixBlock |
MatrixBlock.naryOperations(org.apache.sysml.runtime.matrix.operators.Operator op,
MatrixBlock[] matrices,
org.apache.sysml.runtime.instructions.cp.ScalarObject[] scalars,
MatrixBlock ret) |
static MatrixBlock |
LibMatrixMult.prepMatrixMultTransposeSelfInput(MatrixBlock m1,
boolean leftTranspose,
boolean par) |
MatrixBlock |
MatrixBlock.quaternaryOperations(org.apache.sysml.runtime.matrix.operators.QuaternaryOperator qop,
MatrixBlock um,
MatrixBlock vm,
MatrixBlock wm,
MatrixBlock out) |
MatrixBlock |
MatrixBlock.quaternaryOperations(org.apache.sysml.runtime.matrix.operators.QuaternaryOperator qop,
MatrixBlock U,
MatrixBlock V,
MatrixBlock wm,
MatrixBlock out,
int k) |
static MatrixBlock |
MatrixBlock.randOperations(int rows,
int cols,
double sparsity,
double min,
double max,
String pdf,
long seed)
Function to generate the random matrix with specified dimensions (block sizes are not specified).
|
static MatrixBlock |
MatrixBlock.randOperations(int rows,
int cols,
double sparsity,
double min,
double max,
String pdf,
long seed,
int k)
Function to generate the random matrix with specified dimensions (block sizes are not specified).
|
static MatrixBlock |
MatrixBlock.randOperations(RandomMatrixGenerator rgen,
long seed)
Function to generate the random matrix with specified dimensions and block dimensions.
|
static MatrixBlock |
MatrixBlock.randOperations(RandomMatrixGenerator rgen,
long seed,
int k)
Function to generate the random matrix with specified dimensions and block dimensions.
|
MatrixBlock |
MatrixBlock.randOperationsInPlace(RandomMatrixGenerator rgen,
org.apache.commons.math3.random.Well1024a bigrand,
long bSeed)
Function to generate a matrix of random numbers.
|
MatrixBlock |
MatrixBlock.randOperationsInPlace(RandomMatrixGenerator rgen,
org.apache.commons.math3.random.Well1024a bigrand,
long bSeed,
int k)
Function to generate a matrix of random numbers.
|
MatrixBlock |
MatrixBlock.removeEmptyOperations(MatrixBlock ret,
boolean rows,
boolean emptyReturn) |
MatrixBlock |
MatrixBlock.removeEmptyOperations(MatrixBlock ret,
boolean rows,
boolean emptyReturn,
MatrixBlock select) |
static MatrixBlock |
LibMatrixReorg.reorg(MatrixBlock in,
MatrixBlock out,
org.apache.sysml.runtime.matrix.operators.ReorgOperator op) |
static MatrixBlock |
LibMatrixReorg.reshape(MatrixBlock in,
MatrixBlock out,
int rows,
int cols,
boolean rowwise)
CP reshape operation (single input, single output matrix)
NOTE: In contrast to R, the rowwise parameter specifies both
the read and write order, with row-wise being the default, while
R uses always a column-wise read, rowwise specifying the write
order and column-wise being the default.
|
static MatrixBlock |
LibMatrixReorg.rev(MatrixBlock in,
MatrixBlock out) |
static MatrixBlock |
LibMatrixReorg.rexpand(MatrixBlock in,
MatrixBlock ret,
double max,
boolean rows,
boolean cast,
boolean ignore,
int k)
CP rexpand operation (single input, single output)
|
MatrixBlock |
MatrixBlock.rexpandOperations(MatrixBlock ret,
double max,
boolean rows,
boolean cast,
boolean ignore,
int k) |
static MatrixBlock |
LibMatrixReorg.rmempty(MatrixBlock in,
MatrixBlock ret,
boolean rows,
boolean emptyReturn,
MatrixBlock select)
CP rmempty operation (single input, single output matrix)
|
static MatrixBlock |
MatrixBlock.sampleOperations(long range,
int size,
boolean replace,
long seed) |
static MatrixBlock |
MatrixBlock.seqOperations(double from,
double to,
double incr)
Method to generate a sequence according to the given parameters.
|
MatrixBlock |
MatrixBlock.seqOperationsInPlace(double from,
double to,
double incr) |
MatrixBlock |
MatrixBlock.slice(org.apache.sysml.runtime.util.IndexRange ixrange,
MatrixBlock ret) |
MatrixBlock |
MatrixBlock.slice(int rl,
int ru) |
MatrixBlock |
MatrixBlock.slice(int rl,
int ru,
int cl,
int cu,
boolean deep,
org.apache.sysml.runtime.controlprogram.caching.CacheBlock ret)
Method to perform rightIndex operation for a given lower and upper bounds in row and column dimensions.
|
MatrixBlock |
MatrixBlock.slice(int rl,
int ru,
int cl,
int cu,
org.apache.sysml.runtime.controlprogram.caching.CacheBlock ret) |
static MatrixBlock |
LibMatrixReorg.sort(MatrixBlock in,
MatrixBlock out,
int[] by,
boolean desc,
boolean ixret) |
MatrixBlock |
MatrixBlock.ternaryOperations(org.apache.sysml.runtime.matrix.operators.TernaryOperator op,
MatrixBlock m2,
MatrixBlock m3,
MatrixBlock ret) |
MatrixBlock |
CTableMap.toMatrixBlock(int rlen,
int clen) |
static MatrixBlock |
LibMatrixReorg.transpose(MatrixBlock in,
MatrixBlock out) |
static MatrixBlock |
LibMatrixReorg.transpose(MatrixBlock in,
MatrixBlock out,
int k) |
MatrixBlock |
MatrixBlock.transposeSelfMatrixMultOperations(MatrixBlock out,
org.apache.sysml.lops.MMTSJ.MMTSJType tstype) |
MatrixBlock |
MatrixBlock.transposeSelfMatrixMultOperations(MatrixBlock out,
org.apache.sysml.lops.MMTSJ.MMTSJType tstype,
int k) |
MatrixBlock |
MatrixBlock.uaggouterchainOperations(MatrixBlock mbLeft,
MatrixBlock mbRight,
MatrixBlock mbOut,
org.apache.sysml.runtime.matrix.operators.BinaryOperator bOp,
org.apache.sysml.runtime.matrix.operators.AggregateUnaryOperator uaggOp) |
static MatrixBlock |
LibCommonsMath.unaryOperations(MatrixBlock inj,
String opcode) |
| Modifier and Type | Method and Description |
|---|---|
Pair<MatrixIndexes,MatrixBlock> |
TextCellToRowBlockConverter.next() |
Pair<MatrixIndexes,MatrixBlock> |
BinaryCellToRowBlockConverter.next() |
Pair<MatrixIndexes,MatrixBlock> |
BinaryBlockToRowBlockConverter.next() |
| Modifier and Type | Method and Description |
|---|---|
static void |
LibMatrixAgg.aggregateBinaryMatrix(MatrixBlock in,
MatrixBlock aggVal,
org.apache.sysml.runtime.matrix.operators.AggregateOperator aop)
Core incremental matrix aggregate (ak+) as used for uack+ and acrk+.
|
static void |
LibMatrixAgg.aggregateBinaryMatrix(MatrixBlock in,
MatrixBlock aggVal,
MatrixBlock aggCorr,
boolean deep)
Core incremental matrix aggregate (ak+) as used in mapmult, tsmm,
cpmm, etc.
|
MatrixBlock |
MatrixBlock.aggregateBinaryOperations(MatrixBlock m1,
MatrixBlock m2,
MatrixBlock ret,
org.apache.sysml.runtime.matrix.operators.AggregateBinaryOperator op) |
MatrixBlock |
MatrixBlock.aggregateBinaryOperations(MatrixIndexes m1Index,
MatrixBlock m1,
MatrixIndexes m2Index,
MatrixBlock m2,
MatrixBlock ret,
org.apache.sysml.runtime.matrix.operators.AggregateBinaryOperator op) |
static void |
LibMatrixOuterAgg.aggregateMatrix(MatrixBlock in1Val,
MatrixBlock outVal,
double[] bv,
int[] bvi,
org.apache.sysml.runtime.matrix.operators.BinaryOperator bOp,
org.apache.sysml.runtime.matrix.operators.AggregateUnaryOperator uaggOp) |
static MatrixBlock |
LibMatrixAgg.aggregateTernary(MatrixBlock in1,
MatrixBlock in2,
MatrixBlock in3,
MatrixBlock ret,
org.apache.sysml.runtime.matrix.operators.AggregateTernaryOperator op) |
static MatrixBlock |
LibMatrixAgg.aggregateTernary(MatrixBlock in1,
MatrixBlock in2,
MatrixBlock in3,
MatrixBlock ret,
org.apache.sysml.runtime.matrix.operators.AggregateTernaryOperator op,
int k) |
MatrixBlock |
MatrixBlock.aggregateTernaryOperations(MatrixBlock m1,
MatrixBlock m2,
MatrixBlock m3,
MatrixBlock ret,
org.apache.sysml.runtime.matrix.operators.AggregateTernaryOperator op,
boolean inCP) |
static void |
LibMatrixAgg.aggregateUnaryMatrix(MatrixBlock in,
MatrixBlock out,
org.apache.sysml.runtime.matrix.operators.AggregateUnaryOperator uaop) |
static void |
LibMatrixAgg.aggregateUnaryMatrix(MatrixBlock in,
MatrixBlock out,
org.apache.sysml.runtime.matrix.operators.AggregateUnaryOperator uaop,
int k) |
MatrixBlock |
MatrixBlock.append(MatrixBlock[] that,
MatrixBlock ret,
boolean cbind) |
MatrixBlock |
MatrixBlock.append(MatrixBlock[] that,
MatrixBlock ret,
boolean cbind) |
MatrixBlock |
MatrixBlock.append(MatrixBlock that,
MatrixBlock ret) |
MatrixBlock |
MatrixBlock.append(MatrixBlock that,
MatrixBlock ret,
boolean cbind) |
void |
MatrixBlock.appendRowToSparse(SparseBlock dest,
MatrixBlock src,
int i,
int rowoffset,
int coloffset,
boolean deep) |
void |
MatrixBlock.appendToSparse(MatrixBlock that,
int rowoffset,
int coloffset) |
void |
MatrixBlock.appendToSparse(MatrixBlock that,
int rowoffset,
int coloffset,
boolean deep) |
static void |
LibMatrixDNN.batchNorm2D(MatrixBlock image,
MatrixBlock scale,
MatrixBlock bias,
MatrixBlock runningMean,
MatrixBlock runningVar,
String phase,
double epsilon,
double mu,
MatrixBlock ret,
MatrixBlock retRunningMean,
MatrixBlock retRunningVar,
MatrixBlock resultSaveMean,
MatrixBlock resultSaveInvVariance) |
static void |
LibMatrixDNN.batchNorm2DBackward(MatrixBlock image,
MatrixBlock dout,
MatrixBlock scale,
double epsilon,
MatrixBlock resultSaveMean,
MatrixBlock resultSaveInvVariance,
MatrixBlock dX,
MatrixBlock dScale,
MatrixBlock dBias) |
static void |
LibMatrixDNN.biasAdd(MatrixBlock input,
MatrixBlock bias,
MatrixBlock outputBlock,
int numThreads)
Performs the operation corresponding to the DML script:
ones = matrix(1, rows=1, cols=Hout*Wout)
output = input + matrix(bias %*% ones, rows=1, cols=F*Hout*Wout)
This operation is often followed by conv2d and hence we have introduced bias_add(input, bias) built-in function
|
static void |
LibMatrixDNN.biasMultiply(MatrixBlock input,
MatrixBlock bias,
MatrixBlock outputBlock,
int numThreads)
Performs the operation corresponding to the DML script:
ones = matrix(1, rows=1, cols=Hout*Wout)
output = input * matrix(bias %*% ones, rows=1, cols=F*Hout*Wout)
This operation is often followed by conv2d and hence we have introduced bias_multiply(input, bias) built-in function
|
static void |
LibMatrixBincell.bincellOp(MatrixBlock m1,
MatrixBlock m2,
MatrixBlock ret,
org.apache.sysml.runtime.matrix.operators.BinaryOperator op)
matrix-matrix binary operations, MM, MV
|
static void |
LibMatrixBincell.bincellOp(MatrixBlock m1,
MatrixBlock ret,
org.apache.sysml.runtime.matrix.operators.ScalarOperator op)
matrix-scalar, scalar-matrix binary operations.
|
static void |
LibMatrixBincell.bincellOpInPlace(MatrixBlock m1ret,
MatrixBlock m2,
org.apache.sysml.runtime.matrix.operators.BinaryOperator op)
NOTE: operations in place always require m1 and m2 to be of equal dimensions
|
MatrixBlock |
MatrixBlock.chainMatrixMultOperations(MatrixBlock v,
MatrixBlock w,
MatrixBlock out,
org.apache.sysml.lops.MapMultChain.ChainType ctype) |
MatrixBlock |
MatrixBlock.chainMatrixMultOperations(MatrixBlock v,
MatrixBlock w,
MatrixBlock out,
org.apache.sysml.lops.MapMultChain.ChainType ctype,
int k) |
static void |
LibMatrixDNN.channelSums(MatrixBlock input,
MatrixBlock outputBlock,
int C,
int HW)
Perform channel sum operation
|
org.apache.sysml.runtime.instructions.cp.CM_COV_Object |
MatrixBlock.cmOperations(org.apache.sysml.runtime.matrix.operators.CMOperator op,
MatrixBlock weights) |
static void |
LibMatrixDNNIm2Col.col2imOverSingleImage(int outputN,
MatrixBlock input,
DnnParameters params) |
static void |
LibMatrixDNN.conv2d(MatrixBlock input,
MatrixBlock filter,
MatrixBlock outputBlock,
DnnParameters params)
This method performs convolution (i.e.
|
static void |
LibMatrixNative.conv2d(MatrixBlock input,
MatrixBlock filter,
MatrixBlock outputBlock,
DnnParameters params)
This method performs convolution (i.e.
|
static void |
LibMatrixDNN.conv2dBackwardData(MatrixBlock filter,
MatrixBlock dout,
MatrixBlock outputBlock,
DnnParameters params)
This method computes the backpropogation errors for previous layer of convolution operation
|
static void |
LibMatrixNative.conv2dBackwardData(MatrixBlock filter,
MatrixBlock dout,
MatrixBlock outputBlock,
DnnParameters params)
This method computes the backpropagation errors for previous layer of convolution operation
|
static void |
LibMatrixDNN.conv2dBackwardFilter(MatrixBlock input,
MatrixBlock dout,
MatrixBlock outputBlock,
DnnParameters params)
This method computes the backpropogation errors for filter of convolution operation
|
static void |
LibMatrixNative.conv2dBackwardFilter(MatrixBlock input,
MatrixBlock dout,
MatrixBlock outputBlock,
DnnParameters params)
This method computes the backpropogation errors for filter of convolution operation
|
void |
BinaryBlockToRowBlockConverter.convert(MatrixIndexes k1,
MatrixBlock v1) |
void |
BinaryBlockToTextCellConverter.convert(MatrixIndexes k1,
MatrixBlock v1)
Before calling convert, please make sure to setBlockSize(brlen, bclen);
|
void |
BinaryBlockToBinaryCellConverter.convert(MatrixIndexes k1,
MatrixBlock v1) |
void |
MatrixBlock.copy(int rl,
int ru,
int cl,
int cu,
MatrixBlock src,
boolean awareDestNZ)
In-place copy of matrix src into the index range of the existing current matrix.
|
MatrixBlock |
MatrixBlock.copyShallow(MatrixBlock that) |
static long |
LibMatrixMult.copyUpperToLowerTriangle(MatrixBlock ret)
Used for all version of TSMM where the result is known to be symmetric.
|
org.apache.sysml.runtime.instructions.cp.CM_COV_Object |
MatrixBlock.covOperations(org.apache.sysml.runtime.matrix.operators.COVOperator op,
MatrixBlock that) |
org.apache.sysml.runtime.instructions.cp.CM_COV_Object |
MatrixBlock.covOperations(org.apache.sysml.runtime.matrix.operators.COVOperator op,
MatrixBlock that,
MatrixBlock weights) |
void |
MatrixBlock.ctableOperations(org.apache.sysml.runtime.matrix.operators.Operator op,
double scalarThat,
double scalarThat2,
CTableMap resultMap,
MatrixBlock resultBlock)
D = ctable(A,v2,w)
this <- A; scalar_that <- v2; scalar_that2 <- w; result <- D
(i1,j1,v1) from input1 (this)
(v2) from sclar_input2 (scalarThat)
(w) from scalar_input3 (scalarThat2)
|
abstract void |
MatrixValue.ctableOperations(org.apache.sysml.runtime.matrix.operators.Operator op,
double scalar_that,
double scalar_that2,
CTableMap resultMap,
MatrixBlock resultBlock) |
void |
MatrixCell.ctableOperations(org.apache.sysml.runtime.matrix.operators.Operator op,
double scalarThat,
double scalarThat2,
CTableMap resultMap,
MatrixBlock resultBlock) |
void |
CM_N_COVCell.ctableOperations(org.apache.sysml.runtime.matrix.operators.Operator op,
double scalarThat,
double scalarThat2,
CTableMap resultMap,
MatrixBlock resultBlock) |
void |
MatrixBlock.ctableOperations(org.apache.sysml.runtime.matrix.operators.Operator op,
double scalarThat,
MatrixValue that2Val,
CTableMap resultMap,
MatrixBlock resultBlock)
D = ctable(A,v2,W)
this <- A; scalarThat <- v2; that2 <- W; result <- D
(i1,j1,v1) from input1 (this)
(v2) from sclar_input2 (scalarThat)
(i3,j3,w) from input3 (that2)
|
abstract void |
MatrixValue.ctableOperations(org.apache.sysml.runtime.matrix.operators.Operator op,
double scalarThat,
MatrixValue that2,
CTableMap ctableResult,
MatrixBlock ctableResultBlock) |
void |
MatrixCell.ctableOperations(org.apache.sysml.runtime.matrix.operators.Operator op,
double scalarThat,
MatrixValue that2,
CTableMap resultMap,
MatrixBlock resultBlock) |
void |
CM_N_COVCell.ctableOperations(org.apache.sysml.runtime.matrix.operators.Operator op,
double scalarThat,
MatrixValue that2,
CTableMap resultMap,
MatrixBlock resultBlock) |
void |
MatrixBlock.ctableOperations(org.apache.sysml.runtime.matrix.operators.Operator op,
MatrixIndexes ix1,
double scalarThat,
boolean left,
int brlen,
CTableMap resultMap,
MatrixBlock resultBlock)
Specific ctable case of ctable(seq(...),X), where X is the only
matrix input.
|
abstract void |
MatrixValue.ctableOperations(org.apache.sysml.runtime.matrix.operators.Operator op,
MatrixIndexes ix1,
double scalar_that,
boolean left,
int brlen,
CTableMap resultMap,
MatrixBlock resultBlock) |
void |
MatrixCell.ctableOperations(org.apache.sysml.runtime.matrix.operators.Operator op,
MatrixIndexes ix1,
double scalarThat,
boolean left,
int brlen,
CTableMap resultMap,
MatrixBlock resultBlock) |
void |
CM_N_COVCell.ctableOperations(org.apache.sysml.runtime.matrix.operators.Operator op,
MatrixIndexes ix1,
double scalarThat,
boolean left,
int brlen,
CTableMap resultMap,
MatrixBlock resultBlock) |
void |
MatrixBlock.ctableOperations(org.apache.sysml.runtime.matrix.operators.Operator op,
MatrixValue thatVal,
double scalarThat2,
boolean ignoreZeros,
CTableMap resultMap,
MatrixBlock resultBlock)
D = ctable(A,B,w)
this <- A; that <- B; scalar_that2 <- w; result <- D
(i1,j1,v1) from input1 (this)
(i1,j1,v2) from input2 (that)
(w) from scalar_input3 (scalarThat2)
NOTE: This method supports both vectors and matrices.
|
abstract void |
MatrixValue.ctableOperations(org.apache.sysml.runtime.matrix.operators.Operator op,
MatrixValue that,
double scalar_that2,
boolean ignoreZeros,
CTableMap resultMap,
MatrixBlock resultBlock) |
void |
MatrixCell.ctableOperations(org.apache.sysml.runtime.matrix.operators.Operator op,
MatrixValue that,
double scalarThat2,
boolean ignoreZeros,
CTableMap ctableResult,
MatrixBlock ctableResultBlock) |
void |
CM_N_COVCell.ctableOperations(org.apache.sysml.runtime.matrix.operators.Operator op,
MatrixValue that,
double scalarThat2,
boolean ignoreZeros,
CTableMap resultMap,
MatrixBlock resultBlock) |
void |
MatrixBlock.ctableOperations(org.apache.sysml.runtime.matrix.operators.Operator op,
MatrixValue thatVal,
MatrixValue that2Val,
CTableMap resultMap,
MatrixBlock resultBlock) |
abstract void |
MatrixValue.ctableOperations(org.apache.sysml.runtime.matrix.operators.Operator op,
MatrixValue that,
MatrixValue that2,
CTableMap resultMap,
MatrixBlock resultBlock) |
void |
MatrixCell.ctableOperations(org.apache.sysml.runtime.matrix.operators.Operator op,
MatrixValue that,
MatrixValue that2,
CTableMap resultMap,
MatrixBlock resultBlock) |
void |
CM_N_COVCell.ctableOperations(org.apache.sysml.runtime.matrix.operators.Operator op,
MatrixValue that,
MatrixValue that2,
CTableMap resultMap,
MatrixBlock resultBlock) |
MatrixBlock |
MatrixBlock.ctableSeqOperations(MatrixValue thatMatrix,
double thatScalar,
MatrixBlock resultBlock)
D = ctable(seq,A,w)
this <- seq; thatMatrix <- A; thatScalar <- w; result <- D
(i1,j1,v1) from input1 (this)
(i1,j1,v2) from input2 (that)
(w) from scalar_input3 (scalarThat2)
|
static MatrixBlock |
LibMatrixAgg.cumaggregateUnaryMatrix(MatrixBlock in,
MatrixBlock out,
org.apache.sysml.runtime.matrix.operators.UnaryOperator uop) |
static MatrixBlock |
LibMatrixAgg.cumaggregateUnaryMatrix(MatrixBlock in,
MatrixBlock out,
org.apache.sysml.runtime.matrix.operators.UnaryOperator uop,
int k) |
static MatrixBlock |
LibMatrixReorg.diag(MatrixBlock in,
MatrixBlock out) |
static MatrixBlock.SparsityEstimate |
MatrixBlock.estimateSparsityOnAggBinary(MatrixBlock m1,
MatrixBlock m2,
org.apache.sysml.runtime.matrix.operators.AggregateBinaryOperator op) |
MatrixBlock |
MatrixBlock.extractTriangular(MatrixBlock ret,
boolean lower,
boolean diag,
boolean values) |
static void |
LibMatrixDatagen.generateRandomMatrix(MatrixBlock out,
RandomMatrixGenerator rgen,
org.apache.commons.math3.random.Well1024a bigrand,
long bSeed)
Function to generate a matrix of random numbers.
|
static void |
LibMatrixDatagen.generateRandomMatrix(MatrixBlock out,
RandomMatrixGenerator rgen,
org.apache.commons.math3.random.Well1024a bigrand,
long bSeed,
int k)
Function to generate a matrix of random numbers.
|
static void |
LibMatrixDatagen.generateSample(MatrixBlock out,
long range,
int size,
boolean replace,
long seed)
Generates a sample of size
size from a range of values [1,range]. |
static void |
LibMatrixDatagen.generateSequence(MatrixBlock out,
double from,
double to,
double incr)
Method to generate a sequence according to the given parameters.
|
static LibMatrixBincell.BinaryAccessType |
LibMatrixBincell.getBinaryAccessType(MatrixBlock m1,
MatrixBlock m2) |
static LibMatrixDNNRotate180.Rotate180Worker |
LibMatrixDNNRotate180.Rotate180Worker.getWorker(MatrixBlock in,
MatrixBlock out,
DnnParameters params,
boolean zeroOutSparseOutput,
boolean trans) |
static void |
LibMatrixAgg.groupedAggregate(MatrixBlock groups,
MatrixBlock target,
MatrixBlock weights,
MatrixBlock result,
int numGroups,
org.apache.sysml.runtime.matrix.operators.Operator op) |
static void |
LibMatrixAgg.groupedAggregate(MatrixBlock groups,
MatrixBlock target,
MatrixBlock weights,
MatrixBlock result,
int numGroups,
org.apache.sysml.runtime.matrix.operators.Operator op,
int k) |
static void |
LibMatrixDNNIm2Col.im2col(MatrixBlock in,
MatrixBlock out,
int r,
DnnParameters params,
boolean trans) |
static void |
LibMatrixDNNIm2Col.im2col(MatrixBlock in,
MatrixBlock out,
int r,
int C,
int R,
int S,
int H,
int W,
int P,
int Q,
int stride_h,
int stride_w,
int pad_h,
int pad_w,
boolean trans) |
static void |
LibMatrixDNNIm2Col.im2colSparse(MatrixBlock in,
MatrixBlock out,
int r,
int C,
int R,
int S,
int H,
int W,
int P,
int Q,
int stride_h,
int stride_w,
int pad_h,
int pad_w,
boolean trans) |
static boolean |
LibMatrixBincell.isSparseSafeDivide(org.apache.sysml.runtime.matrix.operators.BinaryOperator op,
MatrixBlock rhs) |
static boolean |
LibMatrixMult.isUltraSparseMatrixMult(MatrixBlock m1,
MatrixBlock m2) |
static boolean |
LibMatrixBincell.isValidDimensionsBinary(MatrixBlock m1,
MatrixBlock m2) |
MatrixBlock |
MatrixBlock.leftIndexingOperations(MatrixBlock rhsMatrix,
org.apache.sysml.runtime.util.IndexRange ixrange,
MatrixBlock ret,
org.apache.sysml.runtime.controlprogram.caching.MatrixObject.UpdateType update) |
MatrixBlock |
MatrixBlock.leftIndexingOperations(MatrixBlock rhsMatrix,
int rl,
int ru,
int cl,
int cu,
MatrixBlock ret,
org.apache.sysml.runtime.controlprogram.caching.MatrixObject.UpdateType update) |
MatrixBlock |
MatrixBlock.leftIndexingOperations(org.apache.sysml.runtime.instructions.cp.ScalarObject scalar,
int rl,
int cl,
MatrixBlock ret,
org.apache.sysml.runtime.controlprogram.caching.MatrixObject.UpdateType update)
Explicitly allow left indexing for scalars.
|
static MatrixBlock |
OperationsOnMatrixValues.matMult(MatrixBlock value1,
MatrixBlock value2,
MatrixBlock valueOut,
org.apache.sysml.runtime.matrix.operators.AggregateBinaryOperator op) |
static MatrixBlock |
OperationsOnMatrixValues.matMult(MatrixIndexes indexes1,
MatrixBlock value1,
MatrixIndexes indexes2,
MatrixBlock value2,
MatrixIndexes indexesOut,
MatrixBlock valueOut,
org.apache.sysml.runtime.matrix.operators.AggregateBinaryOperator op) |
static MatrixBlock |
LibCommonsMath.matrixMatrixOperations(MatrixBlock in1,
MatrixBlock in2,
String opcode) |
static void |
LibMatrixMult.matrixMult(MatrixBlock m1,
MatrixBlock m2,
MatrixBlock ret)
Performs a matrix multiplication and stores the result in the output matrix.
|
static void |
LibMatrixMult.matrixMult(MatrixBlock m1,
MatrixBlock m2,
MatrixBlock ret,
boolean fixedRet)
This method allows one to disabling exam sparsity.
|
static void |
LibMatrixMult.matrixMult(MatrixBlock m1,
MatrixBlock m2,
MatrixBlock ret,
int k)
Performs a multi-threaded matrix multiplication and stores the result in the output matrix.
|
static void |
LibMatrixNative.matrixMult(MatrixBlock m1,
MatrixBlock m2,
MatrixBlock ret,
int k)
Performs matrix multiplication using native library if BLAS is available or else falls back to
Java BLAS.
|
static void |
LibMatrixNative.matrixMult(MatrixBlock m1,
MatrixBlock m2,
MatrixBlock ret,
int k,
boolean examSparsity) |
static void |
LibMatrixMult.matrixMult(MatrixBlock m1,
MatrixBlock m2,
MatrixBlock ret,
int rl,
int ru) |
static void |
LibMatrixMult.matrixMult(MatrixBlock m1,
MatrixBlock m2,
MatrixBlock ret,
int rl,
int ru,
boolean fixedRet) |
static void |
LibMatrixMult.matrixMultChain(MatrixBlock mX,
MatrixBlock mV,
MatrixBlock mW,
MatrixBlock ret,
org.apache.sysml.lops.MapMultChain.ChainType ct)
Performs a matrix multiplication chain operation of type t(X)%*%(X%*%v) or t(X)%*%(w*(X%*%v)).
|
static void |
LibMatrixMult.matrixMultChain(MatrixBlock mX,
MatrixBlock mV,
MatrixBlock mW,
MatrixBlock ret,
org.apache.sysml.lops.MapMultChain.ChainType ct,
int k)
Performs a parallel matrix multiplication chain operation of type t(X)%*%(X%*%v) or t(X)%*%(w*(X%*%v)).
|
static void |
LibMatrixMult.matrixMultPermute(MatrixBlock pm1,
MatrixBlock m2,
MatrixBlock ret1,
MatrixBlock ret2) |
static void |
LibMatrixMult.matrixMultPermute(MatrixBlock pm1,
MatrixBlock m2,
MatrixBlock ret1,
MatrixBlock ret2,
int k) |
static void |
LibMatrixMult.matrixMultTransposeSelf(MatrixBlock m1,
MatrixBlock ret,
boolean leftTranspose) |
static void |
LibMatrixMult.matrixMultTransposeSelf(MatrixBlock m1,
MatrixBlock ret,
boolean leftTranspose,
int k) |
static void |
LibMatrixMult.matrixMultWCeMM(MatrixBlock mW,
MatrixBlock mU,
MatrixBlock mV,
double eps,
MatrixBlock ret,
org.apache.sysml.lops.WeightedCrossEntropy.WCeMMType wt) |
static void |
LibMatrixMult.matrixMultWCeMM(MatrixBlock mW,
MatrixBlock mU,
MatrixBlock mV,
double eps,
MatrixBlock ret,
org.apache.sysml.lops.WeightedCrossEntropy.WCeMMType wt,
int k) |
static void |
LibMatrixMult.matrixMultWDivMM(MatrixBlock mW,
MatrixBlock mU,
MatrixBlock mV,
MatrixBlock mX,
MatrixBlock ret,
org.apache.sysml.lops.WeightedDivMM.WDivMMType wt)
NOTE: This operation has limited NaN support, which is acceptable because all our sparse-safe operations
have only limited NaN support.
|
static void |
LibMatrixMult.matrixMultWDivMM(MatrixBlock mW,
MatrixBlock mU,
MatrixBlock mV,
MatrixBlock mX,
MatrixBlock ret,
org.apache.sysml.lops.WeightedDivMM.WDivMMType wt,
int k)
NOTE: This operation has limited NaN support, which is acceptable because all our sparse-safe operations
have only limited NaN support.
|
static void |
LibMatrixMult.matrixMultWSigmoid(MatrixBlock mW,
MatrixBlock mU,
MatrixBlock mV,
MatrixBlock ret,
org.apache.sysml.lops.WeightedSigmoid.WSigmoidType wt) |
static void |
LibMatrixMult.matrixMultWSigmoid(MatrixBlock mW,
MatrixBlock mU,
MatrixBlock mV,
MatrixBlock ret,
org.apache.sysml.lops.WeightedSigmoid.WSigmoidType wt,
int k) |
static void |
LibMatrixMult.matrixMultWSLoss(MatrixBlock mX,
MatrixBlock mU,
MatrixBlock mV,
MatrixBlock mW,
MatrixBlock ret,
org.apache.sysml.lops.WeightedSquaredLoss.WeightsType wt) |
static void |
LibMatrixMult.matrixMultWSLoss(MatrixBlock mX,
MatrixBlock mU,
MatrixBlock mV,
MatrixBlock mW,
MatrixBlock ret,
org.apache.sysml.lops.WeightedSquaredLoss.WeightsType wt,
int k) |
static void |
LibMatrixMult.matrixMultWuMM(MatrixBlock mW,
MatrixBlock mU,
MatrixBlock mV,
MatrixBlock ret,
org.apache.sysml.lops.WeightedUnaryMM.WUMMType wt,
org.apache.sysml.runtime.functionobjects.ValueFunction fn) |
static void |
LibMatrixMult.matrixMultWuMM(MatrixBlock mW,
MatrixBlock mU,
MatrixBlock mV,
MatrixBlock ret,
org.apache.sysml.lops.WeightedUnaryMM.WUMMType wt,
org.apache.sysml.runtime.functionobjects.ValueFunction fn,
int k) |
void |
MatrixBlock.merge(MatrixBlock that,
boolean appendOnly)
Merge disjoint: merges all non-zero values of the given input into the current
matrix block.
|
void |
MatrixBlock.merge(MatrixBlock that,
boolean appendOnly,
boolean par) |
static MatrixBlock[] |
LibCommonsMath.multiReturnOperations(MatrixBlock in,
String opcode) |
static MatrixBlock |
MatrixBlock.naryOperations(org.apache.sysml.runtime.matrix.operators.Operator op,
MatrixBlock[] matrices,
org.apache.sysml.runtime.instructions.cp.ScalarObject[] scalars,
MatrixBlock ret) |
static MatrixBlock |
MatrixBlock.naryOperations(org.apache.sysml.runtime.matrix.operators.Operator op,
MatrixBlock[] matrices,
org.apache.sysml.runtime.instructions.cp.ScalarObject[] scalars,
MatrixBlock ret) |
static void |
OperationsOnMatrixValues.performCtable(MatrixIndexes indexesIn1,
MatrixValue valueIn1,
double scalarIn2,
boolean left,
int brlen,
CTableMap resultMap,
MatrixBlock resultBlock,
org.apache.sysml.runtime.matrix.operators.Operator op) |
static void |
OperationsOnMatrixValues.performCtable(MatrixIndexes indexesIn1,
MatrixValue valueIn1,
double scalarIn2,
double scalarIn3,
CTableMap resultMap,
MatrixBlock resultBlock,
org.apache.sysml.runtime.matrix.operators.Operator op) |
static void |
OperationsOnMatrixValues.performCtable(MatrixIndexes indexesIn1,
MatrixValue valueIn1,
double scalarIn2,
MatrixIndexes indexesIn3,
MatrixValue valueIn3,
CTableMap resultMap,
MatrixBlock resultBlock,
org.apache.sysml.runtime.matrix.operators.Operator op) |
static void |
OperationsOnMatrixValues.performCtable(MatrixIndexes indexesIn1,
MatrixValue valueIn1,
MatrixIndexes indexesIn2,
MatrixValue valueIn2,
double scalarIn3,
CTableMap resultMap,
MatrixBlock resultBlock,
org.apache.sysml.runtime.matrix.operators.Operator op) |
static void |
OperationsOnMatrixValues.performCtable(MatrixIndexes indexesIn1,
MatrixValue valueIn1,
MatrixIndexes indexesIn2,
MatrixValue valueIn2,
MatrixIndexes indexesIn3,
MatrixValue valueIn3,
CTableMap resultMap,
MatrixBlock resultBlock,
org.apache.sysml.runtime.matrix.operators.Operator op) |
static void |
OperationsOnMatrixValues.performMapGroupedAggregate(org.apache.sysml.runtime.matrix.operators.Operator op,
org.apache.sysml.runtime.matrix.mapred.IndexedMatrixValue inTarget,
MatrixBlock groups,
int ngroups,
int brlen,
int bclen,
ArrayList<org.apache.sysml.runtime.matrix.mapred.IndexedMatrixValue> outlist) |
static List |
OperationsOnMatrixValues.performSlice(org.apache.sysml.runtime.util.IndexRange ixrange,
int brlen,
int bclen,
int iix,
int jix,
MatrixBlock in) |
static void |
LibMatrixDNN.pooling(MatrixBlock input,
MatrixBlock output,
DnnParameters params,
LibMatrixDNN.PoolingType poolType) |
static void |
LibMatrixDNN.poolingBackward(MatrixBlock input,
MatrixBlock dout,
MatrixBlock outputBlock,
DnnParameters params,
boolean performReluBackward,
LibMatrixDNN.PoolingType poolType)
This method computes the backpropogation errors for previous layer of pooling operation
|
static void |
LibMatrixDNNIm2Col.preallocateSparseOutput(MatrixBlock in,
MatrixBlock out) |
static MatrixBlock |
LibMatrixMult.prepMatrixMultTransposeSelfInput(MatrixBlock m1,
boolean leftTranspose,
boolean par) |
MatrixBlock |
MatrixBlock.quaternaryOperations(org.apache.sysml.runtime.matrix.operators.QuaternaryOperator qop,
MatrixBlock um,
MatrixBlock vm,
MatrixBlock wm,
MatrixBlock out) |
MatrixBlock |
MatrixBlock.quaternaryOperations(org.apache.sysml.runtime.matrix.operators.QuaternaryOperator qop,
MatrixBlock U,
MatrixBlock V,
MatrixBlock wm,
MatrixBlock out,
int k) |
static void |
LibMatrixAgg.recomputeIndexes(MatrixBlock out,
org.apache.sysml.runtime.matrix.operators.AggregateUnaryOperator op,
int brlen,
int bclen,
MatrixIndexes ix)
Recompute outputs (e.g., maxindex or minindex) according to block indexes from MR.
|
static void |
LibMatrixDNN.reluBackward(MatrixBlock input,
MatrixBlock dout,
MatrixBlock outputBlock,
int numThreads)
This method computes the backpropagation errors for previous layer of relu operation
|
MatrixBlock |
MatrixBlock.removeEmptyOperations(MatrixBlock ret,
boolean rows,
boolean emptyReturn) |
MatrixBlock |
MatrixBlock.removeEmptyOperations(MatrixBlock ret,
boolean rows,
boolean emptyReturn,
MatrixBlock select) |
static MatrixBlock |
LibMatrixReorg.reorg(MatrixBlock in,
MatrixBlock out,
org.apache.sysml.runtime.matrix.operators.ReorgOperator op) |
static void |
LibMatrixOuterAgg.resetOutputMatrix(MatrixIndexes in1Ix,
MatrixBlock in1Val,
MatrixIndexes outIx,
MatrixBlock outVal,
org.apache.sysml.runtime.matrix.operators.AggregateUnaryOperator uaggOp)
ReSet output matrix
|
static MatrixBlock |
LibMatrixReorg.reshape(MatrixBlock in,
MatrixBlock out,
int rows,
int cols,
boolean rowwise)
CP reshape operation (single input, single output matrix)
NOTE: In contrast to R, the rowwise parameter specifies both
the read and write order, with row-wise being the default, while
R uses always a column-wise read, rowwise specifying the write
order and column-wise being the default.
|
static MatrixBlock |
LibMatrixReorg.rev(MatrixBlock in,
MatrixBlock out) |
static MatrixBlock |
LibMatrixReorg.rexpand(MatrixBlock in,
MatrixBlock ret,
double max,
boolean rows,
boolean cast,
boolean ignore,
int k)
CP rexpand operation (single input, single output)
|
MatrixBlock |
MatrixBlock.rexpandOperations(MatrixBlock ret,
double max,
boolean rows,
boolean cast,
boolean ignore,
int k) |
static MatrixBlock |
LibMatrixReorg.rmempty(MatrixBlock in,
MatrixBlock ret,
boolean rows,
boolean emptyReturn,
MatrixBlock select)
CP rmempty operation (single input, single output matrix)
|
static boolean |
LibMatrixMult.satisfiesMultiThreadingConstraints(MatrixBlock m1,
boolean checkMem,
boolean checkFLOPs,
long FPfactor,
int k) |
static boolean |
LibMatrixMult.satisfiesMultiThreadingConstraints(MatrixBlock m1,
int k) |
static boolean |
LibMatrixAgg.satisfiesMultiThreadingConstraints(MatrixBlock in,
MatrixBlock out,
org.apache.sysml.runtime.matrix.operators.AggregateUnaryOperator uaop,
int k) |
static boolean |
LibMatrixMult.satisfiesMultiThreadingConstraints(MatrixBlock m1,
MatrixBlock m2,
boolean checkMem,
boolean checkFLOPs,
long FPfactor,
int k) |
void |
AdaptivePartialBlock.set(MatrixBlock mb) |
protected static void |
LibMatrixDNNHelper.singleThreadedMatMult(MatrixBlock m1,
MatrixBlock m2,
MatrixBlock ret,
boolean recomputeNNZM1,
boolean recomputeNNZM2,
DnnParameters params) |
MatrixBlock |
MatrixBlock.slice(org.apache.sysml.runtime.util.IndexRange ixrange,
MatrixBlock ret) |
static MatrixBlock |
LibMatrixReorg.sort(MatrixBlock in,
MatrixBlock out,
int[] by,
boolean desc,
boolean ixret) |
MatrixBlock |
MatrixBlock.ternaryOperations(org.apache.sysml.runtime.matrix.operators.TernaryOperator op,
MatrixBlock m2,
MatrixBlock m3,
MatrixBlock ret) |
static MatrixBlock |
LibMatrixReorg.transpose(MatrixBlock in,
MatrixBlock out) |
static MatrixBlock |
LibMatrixReorg.transpose(MatrixBlock in,
MatrixBlock out,
int k) |
MatrixBlock |
MatrixBlock.transposeSelfMatrixMultOperations(MatrixBlock out,
org.apache.sysml.lops.MMTSJ.MMTSJType tstype) |
MatrixBlock |
MatrixBlock.transposeSelfMatrixMultOperations(MatrixBlock out,
org.apache.sysml.lops.MMTSJ.MMTSJType tstype,
int k) |
static void |
LibMatrixNative.tsmm(MatrixBlock m1,
MatrixBlock ret,
boolean leftTrans,
int k) |
MatrixBlock |
MatrixBlock.uaggouterchainOperations(MatrixBlock mbLeft,
MatrixBlock mbRight,
MatrixBlock mbOut,
org.apache.sysml.runtime.matrix.operators.BinaryOperator bOp,
org.apache.sysml.runtime.matrix.operators.AggregateUnaryOperator uaggOp) |
static MatrixBlock |
LibCommonsMath.unaryOperations(MatrixBlock inj,
String opcode) |
| Constructor and Description |
|---|
MatrixBlock(MatrixBlock that) |
MatrixBlock(MatrixBlock that,
SparseBlock.Type stype,
boolean deep) |
TaggedMatrixBlock(MatrixBlock b,
byte t) |
| Modifier and Type | Method and Description |
|---|---|
void |
Matrix.setMatrixDoubleArray(MatrixBlock mb,
OutputInfo oinfo,
InputInfo iinfo)
Method to set matrix as double array.
|
Copyright © 2018 The Apache Software Foundation. All rights reserved.