Modifier and Type | Method and Description |
---|---|
org.apache.spark.api.java.JavaPairRDD<TensorIndexes,TensorBlock> |
SparkExecutionContext.getBinaryTensorBlockRDDHandleForVariable(String varname)
Spark instructions should call this for all tensor inputs except broadcast
variables.
|
org.apache.spark.api.java.JavaPairRDD<TensorIndexes,TensorBlock> |
SparkExecutionContext.getBinaryTensorBlockRDDHandleForVariable(String varname,
int numParts,
boolean inclEmpty) |
static org.apache.spark.api.java.JavaPairRDD<TensorIndexes,TensorBlock> |
SparkExecutionContext.toTensorJavaPairRDD(org.apache.spark.api.java.JavaSparkContext sc,
TensorBlock src,
int blen) |
static org.apache.spark.api.java.JavaPairRDD<TensorIndexes,TensorBlock> |
SparkExecutionContext.toTensorJavaPairRDD(org.apache.spark.api.java.JavaSparkContext sc,
TensorBlock src,
int blen,
int numParts,
boolean inclEmpty) |
Modifier and Type | Method and Description |
---|---|
static TensorBlock |
SparkExecutionContext.toTensorBlock(org.apache.spark.api.java.JavaPairRDD<TensorIndexes,TensorBlock> rdd,
DataCharacteristics dc) |
Modifier and Type | Method and Description |
---|---|
TensorIndexes |
IndexedTensorBlock.getIndexes() |
TensorIndexes |
TensorIndexes.setIndexes(long[] ix) |
TensorIndexes |
TensorIndexes.setIndexes(TensorIndexes that) |
Modifier and Type | Method and Description |
---|---|
int |
TensorIndexes.compareTo(TensorIndexes other) |
void |
IndexedTensorBlock.set(TensorIndexes indexes2,
TensorBlock block2) |
TensorIndexes |
TensorIndexes.setIndexes(TensorIndexes that) |
Constructor and Description |
---|
IndexedTensorBlock(TensorIndexes ind,
TensorBlock b) |
TensorIndexes(TensorIndexes indexes) |
Modifier and Type | Method and Description |
---|---|
TensorBlock |
AggregateUnarySPInstruction.RDDUTensorAggFunction2.call(scala.Tuple2<TensorIndexes,TensorBlock> arg0) |
Modifier and Type | Method and Description |
---|---|
LazyIterableIterator<scala.Tuple2<TensorIndexes,BasicTensorBlock>> |
CopyTensorBlockPairFunction.call(Iterator<scala.Tuple2<TensorIndexes,BasicTensorBlock>> arg0) |
LazyIterableIterator<scala.Tuple2<TensorIndexes,TensorBlock>> |
TensorTensorBinaryOpPartitionFunction.call(Iterator<scala.Tuple2<TensorIndexes,TensorBlock>> arg0) |
Iterator<scala.Tuple2<TensorIndexes,TensorBlock>> |
ReplicateTensorFunction.call(scala.Tuple2<TensorIndexes,TensorBlock> arg0) |
Iterator<scala.Tuple2<TensorIndexes,TensorBlock>> |
ReblockTensorFunction.call(scala.Tuple2<TensorIndexes,TensorBlock> arg0) |
Modifier and Type | Method and Description |
---|---|
LazyIterableIterator<scala.Tuple2<TensorIndexes,BasicTensorBlock>> |
CopyTensorBlockPairFunction.call(Iterator<scala.Tuple2<TensorIndexes,BasicTensorBlock>> arg0) |
LazyIterableIterator<scala.Tuple2<TensorIndexes,TensorBlock>> |
TensorTensorBinaryOpPartitionFunction.call(Iterator<scala.Tuple2<TensorIndexes,TensorBlock>> arg0) |
Iterator<scala.Tuple2<TensorIndexes,TensorBlock>> |
ReplicateTensorFunction.call(scala.Tuple2<TensorIndexes,TensorBlock> arg0) |
Iterator<scala.Tuple2<TensorIndexes,TensorBlock>> |
ReblockTensorFunction.call(scala.Tuple2<TensorIndexes,TensorBlock> arg0) |
Modifier and Type | Method and Description |
---|---|
static org.apache.spark.api.java.JavaPairRDD<TensorIndexes,BasicTensorBlock> |
SparkUtils.copyBinaryBlockTensor(org.apache.spark.api.java.JavaPairRDD<TensorIndexes,BasicTensorBlock> in)
Creates a partitioning-preserving deep copy of the input tensor RDD, where
the indexes and values are copied.
|
static org.apache.spark.api.java.JavaPairRDD<TensorIndexes,BasicTensorBlock> |
SparkUtils.copyBinaryBlockTensor(org.apache.spark.api.java.JavaPairRDD<TensorIndexes,BasicTensorBlock> in,
boolean deep)
Creates a partitioning-preserving copy of the input tensor RDD.
|
Modifier and Type | Method and Description |
---|---|
static IndexedTensorBlock |
SparkUtils.toIndexedTensorBlock(TensorIndexes ix,
TensorBlock mb) |
Modifier and Type | Method and Description |
---|---|
static TensorBlock |
RDDAggregateUtils.aggStableTensor(org.apache.spark.api.java.JavaPairRDD<TensorIndexes,TensorBlock> in,
AggregateOperator aop)
Single block aggregation over pair rdds with corrections for numerical stability.
|
static org.apache.spark.api.java.JavaPairRDD<TensorIndexes,BasicTensorBlock> |
SparkUtils.copyBinaryBlockTensor(org.apache.spark.api.java.JavaPairRDD<TensorIndexes,BasicTensorBlock> in)
Creates a partitioning-preserving deep copy of the input tensor RDD, where
the indexes and values are copied.
|
static org.apache.spark.api.java.JavaPairRDD<TensorIndexes,BasicTensorBlock> |
SparkUtils.copyBinaryBlockTensor(org.apache.spark.api.java.JavaPairRDD<TensorIndexes,BasicTensorBlock> in,
boolean deep)
Creates a partitioning-preserving copy of the input tensor RDD.
|
static IndexedTensorBlock |
SparkUtils.toIndexedTensorBlock(scala.Tuple2<TensorIndexes,TensorBlock> in) |
Modifier and Type | Method and Description |
---|---|
static void |
UtilFunctions.getBlockBounds(TensorIndexes ix,
long[] dims,
int blen,
int[] lower,
int[] upper) |
Copyright © 2020 The Apache Software Foundation. All rights reserved.