Namespace JYPPX.CudaSharp
Classes
- CudaArray
Wraps a CUDA array allocation and its copy helpers. 封装 CUDA array 分配对象及其复制辅助方法。
- CudaDevice
Provides current-device helpers over the CUDA runtime. 提供 CUDA runtime 当前设备相关 helper。
- CudaDeviceGraphMemoryInfo
Captures graph-memory allocator counters for one CUDA device. 捕获单个 CUDA 设备的 graph memory 分配器计数。
- CudaDeviceInfo
Describes one CUDA device as reported by the bridge. 描述桥接层返回的单个 CUDA 设备信息。
- CudaDeviceProperties
Aggregates deployment-relevant CUDA device properties and optional runtime attributes. 聚合模型部署相关的 CUDA 设备属性以及可选 runtime attribute。
- CudaDeviceScope
Restores the previous CUDA current device when disposed. 在释放时恢复之前的 CUDA 当前设备。
- CudaEnvironmentProbe
Probes the current CUDA bridge state and available devices. 探测当前 CUDA bridge 状态和可用设备。
- CudaEnvironmentSnapshot
High-level environment snapshot for CUDA bridge diagnostics. 用于 CUDA bridge 诊断的高层环境快照。
- CudaEvent
Managed wrapper around a CUDA event handle. CUDA event 句柄的托管封装。
- CudaException
Thrown when the CUDA bridge reports a non-success status. 当 CUDA bridge 返回非成功状态时引发。
- CudaGraph
Managed wrapper around a captured CUDA graph. 已捕获 CUDA graph 的托管封装。
- CudaGraphExec
Managed wrapper around an executable CUDA graph. 可执行 CUDA graph 的托管封装。
- CudaManagedMemory
Managed wrapper around a CUDA unified-memory allocation. CUDA unified memory 分配的托管封装。
- CudaMemory
Managed wrapper around a device memory allocation. CUDA 设备内存分配的托管封装。
- CudaMemoryInfo
Reports CUDA device memory availability for the current device. 报告当前 CUDA 设备的显存可用性。
- CudaMemoryPressureSnapshot
Captures CUDA memory pressure and device capability signals for deployment diagnostics. 捕获 CUDA 内存压力和设备能力信号，用于模型部署诊断。
- CudaMipmappedArray
Managed wrapper around a CUDA mipmapped array allocation. CUDA mipmapped array 分配的托管封装。
- CudaOwnedMemoryPool
Owns a CUDA memory pool created through the bridge and releases it during disposal. 拥有通过桥接层创建的 CUDA 内存池，并在释放时销毁它。
- CudaPinnedMemory
Managed wrapper around CUDA pinned host memory. CUDA pinned host memory 的托管封装。
- CudaPitchedMemory
Managed wrapper around a CUDA pitched device allocation for 2D tensor/image-like data. 面向二维张量或图像类数据的 CUDA pitched 设备内存托管封装。
- CudaRegisteredHostMemory
Registers a managed byte buffer as CUDA pinned host memory for asynchronous transfers. 将托管字节缓冲区注册为 CUDA pinned host memory 以支持异步传输。
- CudaRuntimeInfo
Runtime-level CUDA bridge information. CUDA bridge 的 runtime 层信息。
- CudaSharpInfo
Repository-level metadata for the managed CUDA assembly. 托管 CUDA 程序集的仓库级元数据。
- CudaStream
Managed wrapper around a CUDA stream handle. CUDA stream 句柄的托管封装。
Structs
- CudaArrayExtent
Represents the width, height, and depth of a CUDA array extent. 表示 CUDA array 的宽度、高度和深度范围。
- CudaArrayInfo
Provides immutable metadata about a CUDA array. 提供 CUDA array 的不可变元数据。
- CudaArrayMemoryRequirements
Describes device-memory requirements for a CUDA array. 描述 CUDA array 的设备内存需求。
- CudaArraySparseProperties
Describes sparse-tile metadata for a CUDA array. 描述 CUDA array 的稀疏 tile 元数据。
- CudaChannelFormatDescriptor
Describes the channel bit layout for a CUDA array. 描述 CUDA array 的通道位布局。
- CudaGraphEdge
Describes a dependency edge between two CUDA graph nodes. 描述两个 CUDA graph node 之间的一条依赖边。
- CudaGraphNode
Identifies a CUDA graph node owned by a CudaGraph. 标识一个由 CudaGraph 拥有的 CUDA graph node。
- CudaMemoryPool
Identifies a CUDA device memory pool without exposing the raw native handle to ordinary users. 标识一个 CUDA 设备内存池，同时避免向普通用户暴露原生句柄。
- CudaPointerAttributes
Provides diagnostic CUDA pointer metadata without exposing a raw pointer as the main user API. 提供 CUDA 指针诊断元数据，同时避免把裸指针作为主要用户 API 暴露。
- CudaStreamCaptureInfo
Captures CUDA stream graph-capture metadata. 表示 CUDA stream 的 graph capture 元数据。
- CudaStreamPriorityRange
CUDA stream priority range for the current device. 当前设备的 CUDA stream 优先级范围。
Enums
- CudaArrayCreationFlags
Flags that control CUDA array creation behavior. 控制 CUDA array 创建行为的标志。
- CudaArraySparseFlags
Flags that describe sparse CUDA array behavior. 描述 sparse CUDA array 行为的标志。
- CudaChannelFormatKind
Channel-format kinds supported by CUDA arrays and textures. CUDA array 与 texture 支持的通道格式类型。
- CudaDeviceAttribute
CUDA device attributes exposed through the runtime API. 通过 CUDA runtime API 暴露的设备属性。
- CudaDeviceLimit
Identifies CUDA runtime device limits that affect device-side execution behavior. 标识影响设备端执行行为的 CUDA runtime device limit。
- CudaDeviceP2PAttribute
CUDA peer-to-peer attribute identifiers. CUDA 点对点访问属性标识。
- CudaDeviceRuntimeFlags
CUDA runtime device scheduling and mapped-host-memory flags. CUDA runtime 设备调度与 mapped host memory 标志。
- CudaEventCreationFlags
Flags that control CUDA event creation behavior. 控制 CUDA event 创建行为的标志。
- CudaEventRecordFlags
Flags used when recording an event into a stream. 向 stream 记录 event 时使用的标志。
- CudaFunctionCachePreference
Selects the preferred shared-memory/L1 cache split for subsequent CUDA launches. 选择后续 CUDA launch 使用的 shared memory / L1 cache 倾向。
- CudaGpuDirectRdmaWritesScope
Selects the visibility scope for GPU Direct RDMA write flushing. 选择 GPU Direct RDMA 写入刷新的可见性范围。
- CudaGpuDirectRdmaWritesTarget
Selects the target for GPU Direct RDMA write flushing. 选择 GPU Direct RDMA 写入刷新的目标。
- CudaGraphMemoryAttribute
Identifies CUDA graph-memory attributes exposed by
cudaDeviceGetGraphMemAttribute. 标识cudaDeviceGetGraphMemAttribute暴露的 CUDA graph memory 属性。
- CudaGraphNodeType
Identifies CUDA graph node kinds reported by the CUDA runtime. 标识 CUDA runtime 报告的 CUDA graph node 类型。
- CudaHostRegistrationFlags
Flags that control registered host-memory behavior. 控制 registered host memory 行为的标志。
- CudaManagedMemoryAttachmentFlags
Flags that control CUDA managed-memory attachment behavior. 控制 CUDA managed memory 附着行为的标志。
- CudaMemoryAdvice
Memory-advice commands accepted by CUDA managed memory. CUDA managed memory 接受的内存建议命令。
- CudaMemoryPointerType
Describes how CUDA classifies a memory pointer returned by the runtime. 描述 CUDA Runtime 对内存指针的分类方式。
- CudaMemoryPoolAccessFlags
Describes CUDA memory-pool access permissions for a device location. 描述某个 CUDA 设备位置对 memory pool 的访问权限。
- CudaMemoryPoolAttribute
Identifies CUDA memory-pool attributes used by deployment memory management. 标识部署内存管理中常用的 CUDA 内存池属性。
- CudaPinnedMemoryAllocationFlags
Flags that control pinned host-memory allocation behavior. 控制 pinned host memory 分配行为的标志。
- CudaSharedMemoryConfig
Selects CUDA shared-memory bank width for compatible devices. 选择兼容设备上的 CUDA shared-memory bank 宽度。
- CudaStreamCaptureMode
Modes that control CUDA stream capture validation. 控制 CUDA stream capture 校验行为的模式。
- CudaStreamCaptureStatus
Describes the CUDA stream capture state used by CUDA Graph capture. 描述 CUDA Graph 捕获流程中的 CUDA stream 捕获状态。
- CudaStreamCreationFlags
Flags that control CUDA stream creation behavior. 控制 CUDA stream 创建行为的标志。