org.apache.sysml.runtime.matrix.data

Class LibMatrixReorg

java.lang.Object

org.apache.sysml.runtime.matrix.data.LibMatrixReorg

public class LibMatrixReorg
extends Object

MB: Library for selected matrix reorg operations including special cases and all combinations of dense and sparse representations. Current list of supported operations: - reshape, - r' (transpose), - rdiag (diagV2M/diagM2V), - rsort (sorting data/indexes) - rmempty (remove empty) - rexpand (outer/table-seq expansion)

Field Summary

Fields

Modifier and Type	Field and Description
static boolean	ALLOW_BLOCK_REUSE
static long	PAR_NUMCELL_THRESHOLD
static boolean	SHALLOW_COPY_REORG

Method Summary

Modifier and Type	Method and Description
static MatrixBlock	diag(MatrixBlock in, MatrixBlock out)
static boolean	isSupportedReorgOperator(org.apache.sysml.runtime.matrix.operators.ReorgOperator op)
static MatrixBlock	reorg(MatrixBlock in, MatrixBlock out, org.apache.sysml.runtime.matrix.operators.ReorgOperator op)
static ArrayList<org.apache.sysml.runtime.matrix.mapred.IndexedMatrixValue>	reshape(org.apache.sysml.runtime.matrix.mapred.IndexedMatrixValue in, MatrixCharacteristics mcIn, ArrayList<org.apache.sysml.runtime.matrix.mapred.IndexedMatrixValue> out, MatrixCharacteristics mcOut, boolean rowwise) MR/SPARK reshape interface - for reshape we cannot view blocks independently, and hence, there are different CP and MR interfaces.
static MatrixBlock	reshape(MatrixBlock in, MatrixBlock out, int rows, int cols, boolean rowwise) CP reshape operation (single input, single output matrix)
static void	rev(org.apache.sysml.runtime.matrix.mapred.IndexedMatrixValue in, long rlen, int brlen, ArrayList<org.apache.sysml.runtime.matrix.mapred.IndexedMatrixValue> out)
static MatrixBlock	rev(MatrixBlock in, MatrixBlock out)
static void	rexpand(org.apache.sysml.runtime.matrix.mapred.IndexedMatrixValue data, double max, boolean rows, boolean cast, boolean ignore, long brlen, long bclen, ArrayList<org.apache.sysml.runtime.matrix.mapred.IndexedMatrixValue> outList) MR/Spark rexpand operation (single input, multiple outputs incl empty blocks)
static MatrixBlock	rexpand(MatrixBlock in, MatrixBlock ret, double max, boolean rows, boolean cast, boolean ignore, int k) CP rexpand operation (single input, single output)
static void	rmempty(org.apache.sysml.runtime.matrix.mapred.IndexedMatrixValue data, org.apache.sysml.runtime.matrix.mapred.IndexedMatrixValue offset, boolean rmRows, long len, long brlen, long bclen, ArrayList<org.apache.sysml.runtime.matrix.mapred.IndexedMatrixValue> outList) MR rmempty interface - for rmempty we cannot view blocks independently, and hence, there are different CP and MR interfaces.
static MatrixBlock	rmempty(MatrixBlock in, MatrixBlock ret, boolean rows, MatrixBlock select) CP rmempty operation (single input, single output matrix)
static MatrixBlock	sort(MatrixBlock in, MatrixBlock out, int by, boolean desc, boolean ixret)
static MatrixBlock	transpose(MatrixBlock in, MatrixBlock out)
static MatrixBlock	transpose(MatrixBlock in, MatrixBlock out, int k)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

PAR_NUMCELL_THRESHOLD

public static final long PAR_NUMCELL_THRESHOLD

See Also:

Constant Field Values

SHALLOW_COPY_REORG

public static final boolean SHALLOW_COPY_REORG

See Also:

Constant Field Values

ALLOW_BLOCK_REUSE

public static final boolean ALLOW_BLOCK_REUSE

See Also:

Constant Field Values

Method Detail

isSupportedReorgOperator

public static boolean isSupportedReorgOperator(org.apache.sysml.runtime.matrix.operators.ReorgOperator op)

reorg

public static MatrixBlock reorg(MatrixBlock in,
                                MatrixBlock out,
                                org.apache.sysml.runtime.matrix.operators.ReorgOperator op)
                         throws DMLRuntimeException

Throws:

DMLRuntimeException

transpose

public static MatrixBlock transpose(MatrixBlock in,
                                    MatrixBlock out)
                             throws DMLRuntimeException

Throws:

DMLRuntimeException

transpose

public static MatrixBlock transpose(MatrixBlock in,
                                    MatrixBlock out,
                                    int k)
                             throws DMLRuntimeException

Throws:

DMLRuntimeException

rev

public static MatrixBlock rev(MatrixBlock in,
                              MatrixBlock out)
                       throws DMLRuntimeException

Throws:

DMLRuntimeException

rev

public static void rev(org.apache.sysml.runtime.matrix.mapred.IndexedMatrixValue in,
                       long rlen,
                       int brlen,
                       ArrayList<org.apache.sysml.runtime.matrix.mapred.IndexedMatrixValue> out)
                throws DMLRuntimeException

Throws:

DMLRuntimeException

diag

public static MatrixBlock diag(MatrixBlock in,
                               MatrixBlock out)
                        throws DMLRuntimeException

Throws:

DMLRuntimeException

sort

public static MatrixBlock sort(MatrixBlock in,
                               MatrixBlock out,
                               int by,
                               boolean desc,
                               boolean ixret)
                        throws DMLRuntimeException

Throws:

DMLRuntimeException

reshape

public static MatrixBlock reshape(MatrixBlock in,
                                  MatrixBlock out,
                                  int rows,
                                  int cols,
                                  boolean rowwise)
                           throws DMLRuntimeException

CP reshape operation (single input, single output matrix)

Parameters:

in - input matrix

out - output matrix

rows - number of rows

cols - number of columns

rowwise - if true, reshape by row

Returns:

output matrix

Throws:

DMLRuntimeException - if DMLRuntimeException occurs

reshape

public static ArrayList<org.apache.sysml.runtime.matrix.mapred.IndexedMatrixValue> reshape(org.apache.sysml.runtime.matrix.mapred.IndexedMatrixValue in,
                                                                                           MatrixCharacteristics mcIn,
                                                                                           ArrayList<org.apache.sysml.runtime.matrix.mapred.IndexedMatrixValue> out,
                                                                                           MatrixCharacteristics mcOut,
                                                                                           boolean rowwise)
                                                                                    throws DMLRuntimeException

MR/SPARK reshape interface - for reshape we cannot view blocks independently, and hence, there are different CP and MR interfaces.

Parameters:

in - indexed matrix value

mcIn - input matrix characteristics

out - list of indexed matrix values

mcOut - output matrix characteristics

rowwise - if true, reshape by row

Returns:

list of indexed matrix values

Throws:

DMLRuntimeException - if DMLRuntimeException occurs

rmempty

public static MatrixBlock rmempty(MatrixBlock in,
                                  MatrixBlock ret,
                                  boolean rows,
                                  MatrixBlock select)
                           throws DMLRuntimeException

CP rmempty operation (single input, single output matrix)

Parameters:

in - input matrix

ret - output matrix

rows - ?

select - ?

Returns:

matrix block

Throws:

DMLRuntimeException - if DMLRuntimeException occurs

rmempty

public static void rmempty(org.apache.sysml.runtime.matrix.mapred.IndexedMatrixValue data,
                           org.apache.sysml.runtime.matrix.mapred.IndexedMatrixValue offset,
                           boolean rmRows,
                           long len,
                           long brlen,
                           long bclen,
                           ArrayList<org.apache.sysml.runtime.matrix.mapred.IndexedMatrixValue> outList)
                    throws DMLRuntimeException

MR rmempty interface - for rmempty we cannot view blocks independently, and hence, there are different CP and MR interfaces.

Parameters:

data - ?

offset - ?

rmRows - ?

len - ?

brlen - number of rows in a block

bclen - number of columns in a block

outList - list of indexed matrix values

Throws:

DMLRuntimeException - if DMLRuntimeException occurs

rexpand

public static MatrixBlock rexpand(MatrixBlock in,
                                  MatrixBlock ret,
                                  double max,
                                  boolean rows,
                                  boolean cast,
                                  boolean ignore,
                                  int k)
                           throws DMLRuntimeException

CP rexpand operation (single input, single output)

Parameters:

in - input matrix

ret - output matrix

max - ?

rows - ?

cast - ?

ignore - ?

k - degree of parallelism

Returns:

output matrix

Throws:

DMLRuntimeException - if DMLRuntimeException occurs

rexpand

public static void rexpand(org.apache.sysml.runtime.matrix.mapred.IndexedMatrixValue data,
                           double max,
                           boolean rows,
                           boolean cast,
                           boolean ignore,
                           long brlen,
                           long bclen,
                           ArrayList<org.apache.sysml.runtime.matrix.mapred.IndexedMatrixValue> outList)
                    throws DMLRuntimeException

MR/Spark rexpand operation (single input, multiple outputs incl empty blocks)

Parameters:

data - indexed matrix value

max - ?

rows - ?

cast - ?

ignore - ?

brlen - number of rows in a block

bclen - number of columns in a block

outList - list of indexed matrix values

Throws:

DMLRuntimeException - if DMLRuntimeException occurs