Class TensorRtExecutionContextDeploymentSnapshot

Namespace

JYPPX.TensorRtSharp

Assembly

JYPPX.TensorRtSharp.dll

Captures TensorRT execution-context state relevant to dynamic shapes, tensor addresses, and enqueue readiness. 捕获与动态 shape、tensor 地址绑定和 enqueue 就绪状态相关的 TensorRT execution-context 状态。

public sealed class TensorRtExecutionContextDeploymentSnapshot

Inheritance

object

TensorRtExecutionContextDeploymentSnapshot

Inherited Members

object.Equals(object)

object.Equals(object, object)

object.GetHashCode()

object.GetType()

object.ReferenceEquals(object, object)

Properties

AllInputDimensionsSpecified

Gets whether TensorRT reports all input dimensions specified. 获取 TensorRT 是否报告所有输入维度已指定。

public bool AllInputDimensionsSpecified { get; }

Property Value

bool

AllInputShapesSpecified

Gets whether TensorRT reports all input shape tensors specified. 获取 TensorRT 是否报告所有输入 shape tensor 已指定。

public bool AllInputShapesSpecified { get; }

Property Value

bool

ContextName

Gets the execution-context name. 获取 execution context 名称。

public string ContextName { get; }

Property Value

string

DebugSync

Gets whether TensorRT debug synchronization is enabled. 获取 TensorRT debug synchronization 是否启用。

public bool DebugSync { get; }

Property Value

bool

DeviceMemorySizeInBytes

Gets execution-context device-memory requirement. 获取 execution context 设备内存需求。

public ulong DeviceMemorySizeInBytes { get; }

Property Value

ulong

Diagnostics

Gets non-fatal diagnostics collected while building the snapshot. 获取构建快照时收集的非致命诊断信息。

public IReadOnlyList<string> Diagnostics { get; }

Property Value

IReadOnlyList<string>

EngineIOTensorCount

Gets the engine I/O tensor count reached through the context. 获取通过 context 反查到的 engine I/O tensor 数量。

public int EngineIOTensorCount { get; }

Property Value

int

EngineLayerCount

Gets the engine layer count reached through the context. 获取通过 context 反查到的 engine layer 数量。

public int EngineLayerCount { get; }

Property Value

int

EngineName

Gets the engine name reached through the execution context. 获取通过 execution context 反查到的 engine 名称。

public string EngineName { get; }

Property Value

string

EngineOptimizationProfileCount

Gets the engine optimization-profile count reached through the context. 获取通过 context 反查到的 engine optimization profile 数量。

public int EngineOptimizationProfileCount { get; }

Property Value

int

EnqueueEmitsProfile

Gets whether enqueue emits profiling data. 获取 enqueue 是否发出 profiling 数据。

public bool EnqueueEmitsProfile { get; }

Property Value

bool

HasDebugListener

Gets whether a debug listener is attached. 获取是否已绑定 debug listener。

public bool HasDebugListener { get; }

Property Value

bool

HasProfiler

Gets whether a profiler is attached. 获取是否已绑定 profiler。

public bool HasProfiler { get; }

Property Value

bool

HasRuntimeConfig

Gets whether TensorRT exposes a runtime config for this context. 获取 TensorRT 是否为该 context 暴露 runtime config。

public bool HasRuntimeConfig { get; }

Property Value

bool

HasTemporaryStorageAllocator

Gets whether a temporary-storage allocator is attached. 获取是否已绑定 temporary-storage allocator。

public bool HasTemporaryStorageAllocator { get; }

Property Value

bool

InputConsumedEventAddressValue

Gets the input-consumed CUDA event native address as a diagnostic integer value. 获取 input-consumed CUDA event 原生地址的诊断整数值。

public ulong InputConsumedEventAddressValue { get; }

Property Value

ulong

IsInputConsumedEventSet

Gets whether an input-consumed CUDA event is set. 获取是否设置了 input-consumed CUDA event。

public bool IsInputConsumedEventSet { get; }

Property Value

bool

NvtxVerbosity

Gets current NVTX verbosity. 获取当前 NVTX verbosity。

public TensorRtProfilingVerbosity NvtxVerbosity { get; }

Property Value

TensorRtProfilingVerbosity

OptimizationProfileIndex

Gets the active optimization profile index. 获取当前 active optimization profile 索引。

public int OptimizationProfileIndex { get; }

Property Value

int

PersistentCacheLimitInBytes

Gets persistent-cache limit. 获取 persistent cache 限制。

public ulong PersistentCacheLimitInBytes { get; }

Property Value

ulong

RuntimeConfigAllocationStrategy

Gets runtime-config allocation strategy when available. 获取可用时的 runtime config allocation strategy。

public TensorRtExecutionContextAllocationStrategy? RuntimeConfigAllocationStrategy { get; }

Property Value

TensorRtExecutionContextAllocationStrategy?

RuntimeDiagnostics

Gets pointer-free runtime diagnostic snapshots collected for output tensors. 获取为 output tensor 采集的 pointer-free 运行时诊断快照。

public IReadOnlyList<TensorRtExecutionContextRuntimeDiagnosticSnapshot> RuntimeDiagnostics { get; }

Property Value

IReadOnlyList<TensorRtExecutionContextRuntimeDiagnosticSnapshot>

TensorStates

Gets per-tensor context binding states. 获取逐 tensor 的 context 绑定状态。

public IReadOnlyList<TensorRtTensorBindingState> TensorStates { get; }

Property Value

IReadOnlyList<TensorRtTensorBindingState>

UnfusedTensorsDebugState

Gets TensorRT 11 unfused-tensor debug state. 获取 TensorRT 11 unfused tensor debug state。

public bool UnfusedTensorsDebugState { get; }

Property Value

bool

Methods

ToString()

Creates a compact one-line diagnostic summary. 创建紧凑的单行诊断摘要。

public override string ToString()

Returns

string

ToSummary()

Converts this copied execution-context deployment snapshot into a compact pointer-free summary. 将当前已复制 execution-context deployment 快照转换为紧凑、无指针逃逸的摘要。

public TensorRtExecutionContextDeploymentSummary ToSummary()

Returns

TensorRtExecutionContextDeploymentSummary

Remarks

This method only reads managed snapshot values. It does not call TensorRT, expose native context pointers, or promote local deployment diagnostics to runtime proof. 该方法只读取托管快照值；不会调用 TensorRT、暴露原生 context 指针，也不会将本地部署诊断晋级为 runtime proof。