org.apache.sysml.runtime.instructions.gpu.context

Class GPUMemoryManager

java.lang.Object

org.apache.sysml.runtime.instructions.gpu.context.GPUMemoryManager

public class GPUMemoryManager
extends Object

- All cudaFree and cudaMalloc in SystemML should go through this class to avoid OOM or incorrect results. - This class can be refactored in future to accept a chunk of memory ahead of time rather than while execution. This will only thow memory-related errors during startup.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	GPUMemoryManager.GPUComparator Class that governs the eviction policy

Field Summary

Fields

Modifier and Type	Field and Description
double	GPU_MEMORY_UTILIZATION_FACTOR
protected static org.apache.commons.logging.Log	LOG

Constructor Summary

Constructors

Constructor and Description
GPUMemoryManager(GPUContext gpuCtx)

Method Summary

Modifier and Type	Method and Description
void	addGPUObject(GPUObject gpuObj) Adds the GPU object to the memory manager
void	clearMemory() Clear the allocated GPU objects
void	clearTemporaryMemory() Clears up the memory used by non-dirty pointers.
void	free(String opcode, jcuda.Pointer toFree, boolean eager) Deallocate the pointer
long	getAvailableMemory() Gets the available memory on GPU that SystemML can use.
long	getSizeAllocatedGPUPointer(jcuda.Pointer ptr) Get size of allocated GPU Pointer
jcuda.Pointer	malloc(String opcode, long size) Allocate pointer of the given size in bytes.
void	removeGPUObject(GPUObject gpuObj) Removes the GPU object from the memory manager
String	toString() Print debugging information

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

LOG

protected static final org.apache.commons.logging.Log LOG

GPU_MEMORY_UTILIZATION_FACTOR

public double GPU_MEMORY_UTILIZATION_FACTOR

Constructor Detail

GPUMemoryManager

public GPUMemoryManager(GPUContext gpuCtx)

Method Detail

addGPUObject

public void addGPUObject(GPUObject gpuObj)

Adds the GPU object to the memory manager

Parameters:

gpuObj - the handle to the GPU object

removeGPUObject

public void removeGPUObject(GPUObject gpuObj)

Removes the GPU object from the memory manager

Parameters:

gpuObj - the handle to the GPU object

getSizeAllocatedGPUPointer

public long getSizeAllocatedGPUPointer(jcuda.Pointer ptr)

Get size of allocated GPU Pointer

Parameters:

ptr - pointer to get size of

Returns:

either the size or -1 if no such pointer exists

malloc

public jcuda.Pointer malloc(String opcode,
                            long size)
                     throws DMLRuntimeException

Allocate pointer of the given size in bytes.

Parameters:

opcode - instruction name

size - size in bytes

Returns:

allocated pointer

Throws:

DMLRuntimeException - if error

free

public void free(String opcode,
                 jcuda.Pointer toFree,
                 boolean eager)
          throws DMLRuntimeException

Deallocate the pointer

Parameters:

opcode - instruction name

toFree - pointer to free

eager - whether to deallocate eagerly

Throws:

DMLRuntimeException - if error

clearMemory

public void clearMemory()
                 throws DMLRuntimeException

Clear the allocated GPU objects

Throws:

DMLRuntimeException - if error

clearTemporaryMemory

public void clearTemporaryMemory()

Clears up the memory used by non-dirty pointers.

toString

public String toString()

Print debugging information

Overrides:

toString in class Object

getAvailableMemory

public long getAvailableMemory()

Gets the available memory on GPU that SystemML can use.

Returns:

the available memory in bytes