public abstract class LegacyEncoder extends Object implements Externalizable
Modifier and Type | Method and Description |
---|---|
abstract MatrixBlock |
apply(FrameBlock in,
MatrixBlock out)
Encode input data blockwise according to existing transform meta data (transform apply).
|
abstract void |
build(FrameBlock in)
Build the transform meta data for the given block input.
|
void |
buildPartial(FrameBlock in)
Partial build of internal data structures (e.g., in distributed spark operations).
|
abstract MatrixBlock |
encode(FrameBlock in,
MatrixBlock out)
Block encode: build and apply (transform encode).
|
int[] |
getColList() |
MatrixBlock |
getColMapping(FrameBlock meta,
MatrixBlock out)
Obtain the column mapping of encoded frames based on the passed meta data frame.
|
abstract FrameBlock |
getMetaData(FrameBlock out)
Construct a frame block out of the transform meta data.
|
int |
initColList(int[] colList) |
int |
initColList(org.apache.wink.json4j.JSONArray attrs) |
abstract void |
initMetaData(FrameBlock meta)
Sets up the required meta data for a subsequent call to apply.
|
boolean |
isApplicable()
Indicates if this encoder is applicable, i.e, if there is at least one column to encode.
|
int |
isApplicable(int colID)
Indicates if this encoder is applicable for the given column ID, i.e., if it is subject to this transformation.
|
void |
mergeAt(LegacyEncoder other,
int row,
int col)
Merges another encoder, of a compatible type, in after a certain position.
|
void |
prepareBuildPartial()
Allocates internal data structures for partial build.
|
void |
readExternal(ObjectInput in)
Redirects the default java serialization via externalizable to our default hadoop writable serialization for
efficient broadcast/rdd deserialization.
|
void |
setColList(int[] colList) |
void |
shiftCols(int offset) |
LegacyEncoder |
subRangeEncoder(IndexRange ixRange)
Returns a new Encoder that only handles a sub range of columns.
|
void |
updateIndexRanges(long[] beginDims,
long[] endDims)
Update index-ranges to after encoding.
|
void |
writeExternal(ObjectOutput os)
Redirects the default java serialization via externalizable to our default hadoop writable serialization for
efficient broadcast/rdd serialization.
|
public int[] getColList()
public void setColList(int[] colList)
public int initColList(org.apache.wink.json4j.JSONArray attrs)
public int initColList(int[] colList)
public boolean isApplicable()
public int isApplicable(int colID)
colID
- column IDpublic abstract MatrixBlock encode(FrameBlock in, MatrixBlock out)
in
- input frame blockout
- output matrix blockpublic abstract void build(FrameBlock in)
in
- input frame blockpublic void prepareBuildPartial()
public void buildPartial(FrameBlock in)
in
- input frame blockpublic abstract MatrixBlock apply(FrameBlock in, MatrixBlock out)
in
- input frame blockout
- output matrix blockpublic LegacyEncoder subRangeEncoder(IndexRange ixRange)
ixRange
- the range (1-based, begin inclusive, end exclusive)public void mergeAt(LegacyEncoder other, int row, int col)
Encoders
are compatible with themselves and EncoderComposite
is compatible with every
other Encoder
.other
- the encoder that should be merged inrow
- the row where it should be placed (1-based)col
- the col where it should be placed (1-based)public void updateIndexRanges(long[] beginDims, long[] endDims)
beginDims
- begin dimensions of rangeendDims
- end dimensions of rangepublic abstract FrameBlock getMetaData(FrameBlock out)
out
- output frame blockpublic abstract void initMetaData(FrameBlock meta)
meta
- frame blockpublic MatrixBlock getColMapping(FrameBlock meta, MatrixBlock out)
meta
- meta data frame blockout
- output matrixpublic void writeExternal(ObjectOutput os) throws IOException
writeExternal
in interface Externalizable
os
- object outputIOException
- if IOException occurspublic void readExternal(ObjectInput in) throws IOException
readExternal
in interface Externalizable
in
- object inputIOException
- if IOException occurpublic void shiftCols(int offset)
Copyright © 2021 The Apache Software Foundation. All rights reserved.