Can I use in CUDA atomic-operations on remote GPU-RAM over GPUDirect 2.0 P2P?

584 views Asked by At

For example i can use CUDA atomic operations atomicAdd(ptr, val), atomicCAS(ptr, old, new), ... on its global memory (GPU-RAM). With CUDA 6.5.

But can I use these atomic-operations for the remote global memory over GPUDirect 2.0 P2P?

1

There are 1 answers

1
ArchaeaSoftware On BEST ANSWER

No. The GPU atomics are only atomic across the GPU performing the operation. They do not work on host memory or nonlocal device memory.

I'm sure it is a roadmap item for NVIDIA to address these limitations on future platforms, esp. with NVLink.