Class Summary Class Description AggBinaryOp AggUnaryOp BinaryOp DataGenOpA DataGenOp can be rand (or matrix constructor), sequence, and sample - these operators have different parameters and use a map of parameter type to hop position. DataOpA DataOp can be either a persistent read/write or transient read/write - writes will always have at least one input, but all types can have parameters (e.g., for csv literals of delimiter, header, etc). DnnOp FunctionOpThis FunctionOp represents the call to a DML-bodied or external function. Hop IndexingOp LeftIndexingOp LiteralOp MemoTableMemoization Table (hop id, worst-case matrix characteristics). MultiThreadedHopOptional hop interface, to be implemented by multi-threaded hops. NaryOpThe NaryOp Hop allows for a variable number of operands. OptimizerUtils ParameterizedBuiltinOpDefines the HOP for calling an internal function (with custom parameters) from a DML script. QuaternaryOpNote: this hop should be called AggQuaternaryOp in consistency with AggUnaryOp and AggBinaryOp; however, since there does not exist a real QuaternaryOp yet - we can leave it as is for now. ReorgOpReorg (cell) operation: aij Properties: Symbol: ', rdiag, rshape, rsort 1 Operand (except sort and reshape take additional arguments) Semantic: change indices (in mapper or reducer) NOTE MB: reshape integrated here because (1) ParameterizedBuiltinOp requires name-value pairs for params and (2) most importantly semantic of reshape is exactly a reorg op. TernaryOpPrimary use cases for now, are
quantile (<n-1-matrix>, <n-1-matrix>, <literal>): quantile (A, w, 0.5)
quantile (<n-1-matrix>, <n-1-matrix>, <scalar>): quantile (A, w, s)
interquantile (<n-1-matrix>, <n-1-matrix>, <scalar>): interquantile (A, w, s)Keep in mind, that we also have binaries for it w/o weights.
Enum Summary Enum Description AggBinaryOp.MMultMethod AggBinaryOp.SparkAggType BinaryOp.AppendMethod BinaryOp.MMBinaryMethod FunctionOp.FunctionType LeftIndexingOp.LeftIndexingMethod OptimizerUtils.MemoryManagerMemory managers (static partitioned, unified) OptimizerUtils.OptimizationLevelOptimization Types for Compilation O0 STATIC - Decisions for scheduling operations on CP/MR are based on predefined set of rules, which check if the dimensions are below a fixed/static threshold (OLD Method of choosing between CP and MR).
Exception Summary Exception Description HopsExceptionException occurring in the HOP level.