Package org.apache.sysds.resource.cost
Class RDDStats
- java.lang.Object
-
- org.apache.sysds.resource.cost.RDDStats
-
public class RDDStats extends Object
-
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description double
getCost()
Meant to be used at testingboolean
isCollected()
Meant to be used at testing
-
-
-
Constructor Detail
-
RDDStats
public RDDStats(VarStats sourceStats)
Initiates RDD statistics object bound to an existingVarStats
object. Uses HDFS block size to adjust automatically the number of partitions for the current RDD.- Parameters:
sourceStats
- bound variables statistics
-
RDDStats
public RDDStats(long size, int partitions)
Initiates RDD statistics object for intermediate variables (not bound toVarStats
). Intended to be used for intermediate shuffle estimations.- Parameters:
size
- distributed size of the objectpartitions
- target number of partitions; -1 for fitting to HDFS block size
-
-