Namespace JYPPX.TensorRtSharp

Classes

BridgeProbeException

Thrown when the bridge reports a non-success status for a probe operation. 当 bridge 在探测操作中返回非成功状态时引发。

TensorRtAlgorithmSnapshotDesignGate

Evaluates the pointer-free TensorRT algorithm selector result snapshot design gate. 评估 TensorRT algorithm selector result snapshot 的无裸指针设计门。

TensorRtAllocatorCallbackOwner

Managed skeleton and native dry-run diagnostic surface for a future TensorRT allocator callback owner. 未来 TensorRT allocator callback owner 的托管骨架与 native dry-run 诊断表面。

TensorRtAllocatorInterfaceInfoDesignGate

Evaluates the pointer-free TensorRT allocator interface-info metadata design gate. 评估 TensorRT allocator interface-info metadata 的无裸指针设计门。

TensorRtAllocatorLedgerSafetyGate

Evaluates copied allocator owner ledger diagnostics before any real TensorRT allocator callback runtime proof. 在进入真实 TensorRT allocator callback runtime proof 之前，评估复制出的 allocator owner ledger 诊断。

TensorRtAttention

Represents a TensorRT 11 attention object owned by a network. 表示由 network 持有生命周期的 TensorRT 11 attention 对象。

TensorRtAuxiliaryStreamAssignmentSnapshot

Describes the managed lifetime state of execution-context auxiliary CUDA streams without exposing native pointers. 描述 execution context 辅助 CUDA stream 的托管生命周期状态，且不暴露原生指针。

TensorRtBuilder

Managed wrapper around a TensorRT builder. TensorRT builder 的托管封装。

TensorRtBuilderConfig

Managed wrapper around a TensorRT builder configuration. TensorRT builder 配置的托管封装。

TensorRtBuilderConfigDeploymentSnapshot

Captures TensorRT builder configuration values that materially affect engine deployment. 捕获会实质影响 engine 部署结果的 TensorRT builder 配置值。

TensorRtBuilderConfigDeploymentSummary

Compact pointer-free summary of TensorRT builder configuration deployment settings. TensorRT builder config deployment 设置的紧凑无指针摘要。

TensorRtBuilderConfigSerializedPluginSnapshot

Represents a copied read-only snapshot of TensorRT builder config serialized plugin paths. 表示 TensorRT builder config serialized plugin path 的复制型只读快照。

TensorRtCaffeBinaryProtoSnapshot

Contains caller-owned data and metadata copied from a TensorRT 8 Caffe binaryproto blob. 包含从 TensorRT 8 Caffe binaryproto blob 复制的 caller-owned 数据与元数据。

TensorRtCalibratorMetadataDesignGate

Evaluates the pointer-free TensorRT INT8 calibrator metadata design gate. 评估 TensorRT INT8 calibrator metadata 的无裸指针设计门。

TensorRtCallbackAllocatorReadiness

Aggregates managed callback and allocator readiness evidence without invoking TensorRT or exposing native pointers. 聚合托管 callback 与 allocator readiness 证据；不会调用 TensorRT，也不会暴露 native pointer。

TensorRtCallbackAllocatorReadinessSnapshot

Pointer-free readiness summary for managed callback and allocator safety surfaces. managed callback 与 allocator 安全面的无指针 readiness 摘要。

TensorRtCallbackOwnerClosureMatrix

Builds a pointer-free callback owner closure matrix across TensorRT callback families. 构建不暴露裸指针的 TensorRT callback owner 闭环矩阵。

TensorRtCallbackOwnerClosureMatrixResult

Reports the aggregated callback owner closure matrix. 报告聚合后的 callback owner 闭环矩阵。

TensorRtDebugListenerAttachDetachDesignGate

Evaluates the pointer-free DebugListener attach/detach design gate before any real TensorRT callback bridge exists. 中文：该成员报告 DebugListener 无裸指针边界状态，不代表真实 TensorRT 回调运行证明。

TensorRtDebugListenerAttachVTableSafetyGate

Evaluates copied DebugListener attach/vtable prerequisites before a native no-throw callback bridge exists. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能替代真实 TensorRT callback runtime proof。

TensorRtDebugListenerBorrowedDebugTensorMetadataRuntimeGate

Evaluates pointer-free borrowed debug tensor metadata runtime gate evidence. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能作为真实 TensorRT callback runtime proof。

TensorRtDebugListenerBorrowedTensorSafetyGate

Evaluates copied DebugListener borrowed tensor/data lifetime rules before any real TensorRT callback runtime proof exists. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能替代真实 TensorRT callback runtime proof。

TensorRtDebugListenerCallbackOwner

Owns a TensorRT 10/11 debug-listener callback and its managed lifetime. 管理 TensorRT 10/11 debug-listener callback 及其托管生命周期。

TensorRtDebugListenerCallbackProofGapReport

Builds a pointer-free DebugListener callback proof gap report. 该成员提供 DebugListener callback proof 缺口的只读诊断信息；不能替代真实 TensorRT callback runtime proof。

TensorRtDebugListenerCallbackProofGapReportResult

Reports DebugListener callback proof gaps without exposing native pointers. 该成员提供 DebugListener callback proof 缺口的只读诊断信息；不能替代真实 TensorRT callback runtime proof。

TensorRtDebugListenerExceptionStatusMappingGate

Evaluates pointer-free DebugListener callback exception-to-status mapping gate evidence. 中文：该成员报告 DebugListener 无裸指针边界状态，不代表真实 TensorRT 回调运行证明。

TensorRtDebugListenerInFlightAccountingGate

Evaluates pointer-free DebugListener callback in-flight accounting gate evidence. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能替代真实 TensorRT callback runtime proof。

TensorRtDebugListenerNativeAttachBridgeShapeGate

Evaluates pointer-free DebugListener native attach bridge shape evidence before non-null attach is enabled. 中文：该成员报告 DebugListener 无裸指针边界状态，不代表真实 TensorRT 回调运行证明。

TensorRtDebugListenerNativeAttachEntryDesignGate

Evaluates the pointer-free DebugListener native attach entry design gate before non-null attach can be implemented. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能替代真实 TensorRT callback runtime proof。

TensorRtDebugListenerNativeAttachEntryMinimalSafety

Evaluates pointer-free DebugListener native attach entry minimal-safety evidence. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能替代真实 TensorRT callback runtime proof。

TensorRtDebugListenerNativeAttachEntryRuntimeScaffold

Evaluates pointer-free DebugListener native attach entry runtime scaffold readiness. 中文：该成员报告 DebugListener 无裸指针边界状态，不代表真实 TensorRT 回调运行证明。

TensorRtDebugListenerNativeAttachNoThrowPreflight

Evaluates DebugListener native attach/no-throw prerequisites before a native callback bridge is enabled. 中文：该成员报告 DebugListener 无裸指针边界状态，不代表真实 TensorRT 回调运行证明。

TensorRtDebugListenerNativeDetachBeforeReleaseDesignGate

Evaluates the pointer-free DebugListener native detach-before-release design gate before a native callback owner can be released. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能替代真实 TensorRT callback runtime proof。

TensorRtDebugListenerNativeNoThrowDestructor

Evaluates pointer-free DebugListener native owner no-throw destructor evidence before native attach is enabled. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能替代真实 TensorRT callback runtime proof。

TensorRtDebugListenerNativeNoThrowVTableDesignGate

Evaluates the pointer-free DebugListener native no-throw vtable design gate before a native callback bridge is enabled. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能替代真实 TensorRT callback runtime proof。

TensorRtDebugListenerNativeNoThrowVTableScaffoldGate

Evaluates pointer-free DebugListener native no-throw vtable scaffold gate evidence. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能替代真实 TensorRT callback runtime proof。

TensorRtDebugListenerNativeOwnerAddressDesignGate

Evaluates the pointer-free DebugListener native owner address design gate before a native callback bridge is enabled. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能替代真实 TensorRT callback runtime proof。

TensorRtDebugListenerNativeOwnerLifecycleDryRun

Evaluates a pointer-free DebugListener native owner lifecycle dry-run before a native callback owner is implemented. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能作为真实 TensorRT callback runtime proof。

TensorRtDebugListenerNativeOwnerLifecycleGate

Evaluates pointer-free DebugListener native owner lifecycle gate evidence before native attach is enabled. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能作为真实 TensorRT callback runtime proof。

TensorRtDebugListenerNativeOwnerNonCopyableStorage

Evaluates pointer-free DebugListener native owner non-copyable storage evidence before native attach is enabled. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能替代真实 TensorRT callback runtime proof。

TensorRtDebugListenerNativeOwnerStableIdentity

Evaluates pointer-free DebugListener native owner stable identity evidence before a native owner is implemented. 中文：该成员报告 DebugListener 无裸指针边界状态，不代表真实 TensorRT 回调运行证明。

TensorRtDebugListenerNativeOwnerVTableInstallExperiment

Evaluates disabled-by-default DebugListener native owner/vtable install experiment evidence. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能替代真实 TensorRT callback runtime proof。

TensorRtDebugListenerNativeVTableInstallPreflight

Evaluates pointer-free DebugListener native vtable install preflight evidence before installation is enabled. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能作为真实 TensorRT callback runtime proof。

TensorRtDebugListenerNoThrowVTableCallbackStub

Evaluates pointer-free DebugListener no-throw vtable callback stub evidence. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能作为真实 TensorRT callback runtime proof。

TensorRtDebugListenerProcessDebugTensorCallbackTrampoline

Evaluates pointer-free DebugListener processDebugTensor callback trampoline shape evidence. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能作为真实 TensorRT callback runtime proof。

TensorRtDebugListenerRealCallbackRuntimeProof

Evaluates the final, pointer-free DebugListener real callback runtime proof promotion gate. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能替代真实 TensorRT callback runtime proof。

TensorRtDebugListenerRealNonNullAttachRuntimeSmoke

Builds a pointer-free report for a disabled-by-default DebugListener non-null attach runtime smoke attempt. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能替代真实 TensorRT callback runtime proof。

TensorRtDebugListenerRuntimeProofAttemptPreflight

Evaluates whether DebugListener real callback runtime proof work may be attempted. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能替代真实 TensorRT callback runtime proof。

TensorRtDebugListenerRuntimeProofPrecheck

Evaluates whether the DebugListener owner design snapshot is ready for the next real callback runtime proof stage. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能作为真实 TensorRT callback runtime proof。

TensorRtDependencyProbeReport

Non-throwing diagnostic report for native bridge, TensorRT, parser, CUDA, and cuDNN dependency resolution. 用于 native bridge、TensorRT、parser、CUDA 与 cuDNN 依赖解析的非抛异常诊断报告。

TensorRtDimensionExpressionSnapshotDesignGate

Evaluates the pointer-free TensorRT dimension expression snapshot design gate. 评估 TensorRT dimension expression snapshot 的无裸指针设计门。

TensorRtDims

Represents a TensorRT dimension vector. 表示一个 TensorRT 维度向量。

TensorRtDims64

Represents TensorRT 11 dimensions whose extents are reported as 64-bit values. 表示 TensorRT 11 中以 64 位整数报告的维度信息。

TensorRtEngine

Managed wrapper around a TensorRT engine. TensorRT engine 的托管封装。

TensorRtEngineBindingReport

Summarizes TensorRT engine I/O metadata and optional execution-context readiness for deployment. 汇总 TensorRT engine I/O 元数据以及可选 execution-context 就绪状态，用于模型部署诊断。

TensorRtEngineDeploymentSnapshot

Captures TensorRT engine deployment metadata that is useful before binding buffers and enqueueing inference. 捕获在绑定缓冲区与提交推理前有价值的 TensorRT engine 部署元数据。

TensorRtEngineDeploymentSummary

Compact pointer-free summary of TensorRT engine deployment metadata. TensorRT engine deployment 元数据的紧凑无指针摘要。

TensorRtEngineInspector

Managed wrapper around a TensorRT engine inspector. TensorRT engine inspector 的托管封装。

TensorRtEngineProfileTensorValuesSnapshot

Captures copied ICudaEngine profile tensor values for one tensor/profile/selector query. 捕获单个 tensor/profile/selector 查询对应的 ICudaEngine profile tensor values 复制快照。

TensorRtEngineTensorBinding

Describes one TensorRT engine I/O tensor for deployment binding diagnostics. 描述一个 TensorRT engine I/O tensor 的部署绑定诊断信息。

TensorRtEnvironmentProbe

Queries the current bridge state without requiring TensorRT inference to succeed. 在不要求 TensorRT 推理成功的前提下查询当前 bridge 状态。

TensorRtEnvironmentSnapshot

High-level environment snapshot for the native TensorRT bridge. 原生 TensorRT bridge 的高层环境快照。

TensorRtErrorCodeMetadata

Provides pointer-free TensorRT error-code enum metadata. 提供无指针的 TensorRT error-code 枚举元数据。

TensorRtErrorRecord

Represents one copied TensorRT error-recorder entry. 表示一条已复制到托管内存的 TensorRT error-recorder 记录。

TensorRtErrorRecorderDiagnosticsDesignGate

Evaluates the pointer-free TensorRT ErrorRecorder diagnostics design gate. 评估 TensorRT ErrorRecorder 只读诊断的无裸指针设计门。

TensorRtErrorRecorderSnapshot

Represents a copied read-only snapshot of a TensorRT error recorder. 表示 TensorRT error recorder 的只读托管快照。

TensorRtErrorRecorderSummary

Represents a compact pointer-free summary of a copied TensorRT error-recorder snapshot. 表示 TensorRT error-recorder 已复制快照的紧凑无指针摘要。

TensorRtException

Base exception for TensorRT bridge operations. TensorRT bridge 操作的基础异常类型。

TensorRtExecutionContext

Represents a managed TensorRT Tensor Rt Execution Context wrapper. 表示托管 TensorRT Tensor Rt Execution Context 包装器。

TensorRtExecutionContextCallbackAllocatorSafeControlSummary

Pointer-free summary of execution-context callback allocator safe controls. execution context callback allocator 安全控制面的无指针摘要。

TensorRtExecutionContextCallbackStateSnapshot

Copied read-only snapshot of execution-context callback boundary state. execution context 回调边界状态的只读复制快照。

TensorRtExecutionContextDeploymentSnapshot

Captures TensorRT execution-context state relevant to dynamic shapes, tensor addresses, and enqueue readiness. 捕获与动态 shape、tensor 地址绑定和 enqueue 就绪状态相关的 TensorRT execution-context 状态。

TensorRtExecutionContextDeploymentSummary

Compact pointer-free summary of TensorRT execution-context deployment state. TensorRT execution-context deployment 状态的紧凑无指针摘要。

TensorRtExecutionContextReadiness

Summarizes whether a TensorRT execution context has enough shape and address state for enqueue. 汇总 TensorRT execution context 是否已经具备 enqueue 所需的 shape 与地址绑定状态。

TensorRtExecutionContextRuntimeDiagnosticSnapshot

Captures pointer-free execution-context runtime diagnostics for one output tensor. 捕获单个输出 tensor 对应的 execution context 运行时诊断快照；不暴露任何 borrowed pointer。

TensorRtExecutionContextRuntimeDiagnosticSummary

Compact pointer-free summary for an execution-context runtime diagnostic snapshot. execution-context runtime 诊断快照的简短无指针摘要。

TensorRtGlobalRuntimeVersion

Read-only TensorRT global runtime version details collected without creating a runtime. 无需创建 runtime 即可采集的 TensorRT 全局 runtime 版本信息。

TensorRtGpuAllocatorCallbackOwner

Owns a native TensorRT IGpuAllocator and its pointer-free managed policy callback. 管理 native TensorRT IGpuAllocator 及其无指针托管策略回调。

TensorRtHostMemory

Managed wrapper around TensorRT host memory. TensorRT host memory 的托管封装。

TensorRtIfConditional

Represents a TensorRT if-conditional definition owned by a network. 表示由 network 持有生命周期的 TensorRT if-conditional 定义。

TensorRtInferenceBindings

High-level TensorRT inference binding set for deployment-oriented enqueue flows. 面向模型部署 enqueue 流程的高层 TensorRT 推理绑定集。

TensorRtInferenceBuffer

Describes one managed inference buffer bound to a TensorRT engine tensor. 描述一个绑定到 TensorRT engine tensor 的托管推理缓冲区。

TensorRtInferenceExecutionSummary

Summarizes one TensorRT inference enqueue attempt. 汇总一次 TensorRT 推理 enqueue 操作。

TensorRtLayer

Represents a managed TensorRT Tensor Rt Layer wrapper. 表示托管 TensorRT Tensor Rt Layer 包装器。

TensorRtLayerTensorMetadata

Describes one TensorRT layer input or output tensor slot for deployment diagnostics. 描述 TensorRT layer 的一个输入或输出 tensor 槽位，用于部署诊断。

TensorRtLegacyParserDiagnostics

Provides pointer-free readonly diagnostics for TensorRT 8 legacy UFF and Caffe parser assets. 提供 TensorRT 8 legacy UFF 与 Caffe parser 资产的无指针只读诊断。

TensorRtLegacyUffRequiredVersionSnapshot

Contains the UFF version required by the TensorRT 8 legacy parser. 包含 TensorRT 8 legacy parser 所需的 UFF 版本。

TensorRtLogger

Managed wrapper around a TensorRT logger. TensorRT logger 的托管封装。

TensorRtLoggerFinderMetadataDesignGate

Evaluates the pointer-free TensorRT ILoggerFinder metadata design gate. 评估 TensorRT ILoggerFinder metadata 的无裸指针设计门。

TensorRtLoop

Represents a TensorRT loop definition owned by a network. 表示由 network 持有生命周期的 TensorRT loop 定义。

TensorRtNativeDependencyInfo

Describes a native bridge, TensorRT, CUDA, cuDNN, or parser DLL discovered by a dependency probe. 描述依赖探针发现的 native bridge、TensorRT、CUDA、cuDNN 或 parser DLL。

TensorRtNetworkDefinition

Represents a managed TensorRT Tensor Rt Network Definition wrapper. 表示托管 TensorRT Tensor Rt Network Definition 包装器。

TensorRtOnnxConfig

Managed wrapper around a TensorRT ONNX parser configuration. TensorRT ONNX parser 配置的托管封装。

TensorRtOnnxConfigSnapshot

Pointer-free copied snapshot of a TensorRT ONNX parser configuration. TensorRT ONNX parser 配置的无指针复制快照。

TensorRtOnnxConfigSummary

Compact pointer-free summary of a TensorRT ONNX parser configuration snapshot. TensorRT ONNX parser 配置快照的紧凑无指针摘要。

TensorRtOnnxLayerOutputTensorMetadata

Contains copied metadata for one ONNX parser layer output tensor without retaining the parser-owned tensor pointer. 包含一个 ONNX parser layer 输出张量的复制元数据，不保留 parser 拥有的 tensor 指针。

TensorRtOnnxModelSupportReport

Describes whether TensorRT reports support for an ONNX model and its parser subgraphs. 描述 TensorRT 是否支持指定 ONNX 模型以及 parser 子图支持情况。

TensorRtOnnxModelSupportSummary

Summarizes copied ONNX parser model-support diagnostics without exposing native pointers. 汇总已复制的 ONNX parser 模型支持性诊断，不暴露原生指针。

TensorRtOnnxParser

Parses ONNX models into a TensorRT network definition. 将 ONNX 模型解析到 TensorRT network definition。

TensorRtOnnxParserDiagnostic

Provides detailed diagnostics for one ONNX parser error reported by TensorRT. 表示 TensorRT ONNX 解析器报告的一条详细错误诊断信息。

TensorRtOnnxParserDiagnosticSnapshot

Captures copied, pointer-free ONNX parser diagnostics and inventory state. 捕获已复制、无指针逃逸的 ONNX parser 诊断与 inventory 状态。

TensorRtOnnxParserDiagnosticSummary

Summarizes copied, pointer-free ONNX parser diagnostic inventory state. 汇总已复制、无指针逃逸的 ONNX parser 诊断 inventory 状态。

TensorRtOnnxParserRefitter

Provides a safe managed wrapper over TensorRT ONNX parser-refitter diagnostics. 提供 TensorRT ONNX parser-refitter 诊断信息的安全托管封装。

TensorRtOnnxParserRefitterDiagnosticSnapshot

Captures copied, pointer-free ONNX parser-refitter diagnostics. 捕获已复制、无指针逃逸的 ONNX parser-refitter 诊断信息。

TensorRtOnnxParserRefitterDiagnosticSummary

Summarizes copied, pointer-free ONNX parser-refitter diagnostics. 汇总已复制、无指针逃逸的 ONNX parser-refitter 诊断信息。

TensorRtOnnxSubgraphSupportInfo

Describes one ONNX parser subgraph support result. 描述一条 ONNX parser 子图支持性结果。

TensorRtOptimizationProfile

Wraps a TensorRT optimization profile used to describe dynamic input ranges during engine building. 封装 TensorRT 优化配置文件，用于在构建引擎时描述动态输入的 min/opt/max 范围。

TensorRtOptimizationProfileShapeRange

Represents the min/opt/max dimension range of a TensorRT optimization profile input. 表示 TensorRT 优化 profile 输入张量的 min/opt/max 维度范围。

TensorRtOptimizationProfileShapeRange64

Describes a TensorRT 11 min/opt/max shape range using 64-bit dimension extents. 使用 64 位维度 extent 描述 TensorRT 11 的 min/opt/max shape 范围。

TensorRtOptimizationProfileShapeValueRange

Represents the min/opt/max integer value range of a TensorRT shape tensor input. 表示 TensorRT shape tensor 输入的 min/opt/max 整数取值范围。

TensorRtOptimizationProfileShapeValueRangeV2

Represents the min/opt/max 64-bit value range of a TensorRT shape tensor input. 表示 TensorRT shape tensor 输入的 min/opt/max 64 位整数取值范围。

TensorRtOutputAllocatorAttachDetachDesignGate

Evaluates the pointer-free OutputAllocator attach/detach design gate before any real TensorRT callback bridge exists. 中文：该成员报告 OutputAllocator 无裸指针边界状态，不代表真实 TensorRT 回调运行证明。

TensorRtOutputAllocatorCallbackOwner

Owns a TensorRT output allocator callback and its managed lifetime. 管理 TensorRT output allocator callback 及其托管生命周期。

TensorRtOutputAllocatorRuntimeProofPrecheck

Evaluates whether the OutputAllocator owner design snapshot is ready for the next real callback runtime proof stage. 该成员提供 OutputAllocator callback 安全边界的只读诊断信息；不会暴露 native output buffer 指针。

TensorRtOutputBufferOwnershipSafetyGate

Evaluates copied OutputAllocator output-buffer ownership rules before any real TensorRT callback runtime proof exists. 该成员提供 OutputAllocator 输出缓冲区所有权边界的只读诊断信息；不会暴露 native 指针。

TensorRtParserErrorInfo

Provides fixed-buffer ONNX parser error information returned by TensorRT. 表示 TensorRT 返回的固定缓冲区 ONNX parser 错误信息。

TensorRtPluginCreatorInfo

Read-only metadata for a TensorRT plugin creator. TensorRT plugin creator 的只读元数据。

TensorRtPluginCreatorSummary

Pointer-free summary metadata for a TensorRT plugin creator. TensorRT plugin creator 的无指针摘要元数据。

TensorRtPluginCreatorV3MetadataDesignGate

Evaluates the pointer-free TensorRT PluginCreatorV3 and IVersionedInterface metadata design gate. 评估 TensorRT PluginCreatorV3 与 IVersionedInterface metadata 的无裸指针设计门。

TensorRtPluginFieldInfo

Read-only metadata for a TensorRT plugin creator field. TensorRT plugin creator 字段的只读元数据。

TensorRtPluginFieldSummary

Pointer-free summary metadata for one TensorRT plugin creator field. TensorRT plugin creator 字段的无指针摘要元数据。

TensorRtPluginFormatSupportSnapshot

Copied format-combination decisions for the data types and first allowed formats declared by a network-owned layer. 针对 network-owned layer 声明的数据类型与首个允许格式复制出的格式组合结果。

TensorRtPluginRegistryInventory

Read-only snapshot of a TensorRT plugin registry. TensorRT plugin registry 的只读快照。

TensorRtPluginRegistryInventoryDiagnostics

Diagnostics for already-copied TensorRT plugin registry metadata. 已复制 TensorRT plugin registry 元数据的诊断信息。

TensorRtPluginV2LayerMetadata

Pointer-free metadata copied from a TensorRT PluginV2 layer. 从 TensorRT PluginV2 layer 复制出的无指针元数据。

TensorRtPluginV3BuildIoSnapshot

Copied PluginV3 build IO query results. PluginV3 build IO 查询结果副本。

TensorRtPluginV3BuildMetadata

Copied safe-query metadata from a PluginV3 build capability. PluginV3 build capability 的安全查询元数据副本。

TensorRtPluginV3CoreMetadata

Copied PluginV3 core capability metadata. PluginV3 core capability 元数据副本。

TensorRtPluginV3LayerMetadata

Pointer-free metadata copied from a TensorRT PluginV3 layer and its capability interfaces. 从 TensorRT PluginV3 layer 及其 capability interface 复制出的无指针元数据。

TensorRtPluginV3RuntimeMetadata

Copied PluginV3 runtime capability metadata. PluginV3 runtime capability 元数据副本。

TensorRtPluginV3SerializationFieldInventory

Pointer-free inventory copied from IPluginV3OneRuntime serialization fields. 从 IPluginV3OneRuntime 序列化字段复制出的无指针 inventory。

TensorRtProfiler

Managed owner for a TensorRT profiler callback object. TensorRT profiler 回调对象的托管 owner。

TensorRtProgressMonitor

Managed owner for a TensorRT progress monitor callback object. TensorRT progress monitor 回调对象的托管 owner。

TensorRtRefitWeightsBuffer

Keeps TensorRT refit weights pinned while the native refitter may need to read them. 在原生 refitter 可能读取权重期间，保持 TensorRT refit 权重处于 pinned 状态。

TensorRtRefitter

Provides a safe managed wrapper over TensorRT refitter operations. 提供 TensorRT refitter 操作的安全托管封装。

TensorRtRefitterDiagnosticSnapshot

Captures copied read-only diagnostics for a TensorRT refitter instance. 捕获 TensorRT refitter 实例的复制型只读诊断信息。

TensorRtRefitterDiagnosticSummary

Compact pointer-free summary for a TensorRT refitter diagnostic snapshot. TensorRT refitter 诊断快照的简短无指针摘要。

TensorRtRnnV2BorrowedStateDesignGate

Evaluates the TensorRT 8 RNNv2 borrowed tensor and gate-weight design boundary. 评估 TensorRT 8 RNNv2 borrowed tensor 与 gate weights 的设计边界。

TensorRtRnnV2GateWeightsSnapshot

Represents a copied TensorRT 8 RNNv2 gate weight or bias snapshot. 表示复制后的 TensorRT 8 RNNv2 gate weight 或 bias 快照。

TensorRtRuntime

Managed wrapper around a TensorRT runtime. TensorRT runtime 的托管封装。

TensorRtRuntimeConfig

Wraps TensorRT IRuntimeConfig for execution-context creation. 封装 TensorRT IRuntimeConfig，用于创建 execution context。

TensorRtRuntimeConfigSummary

Compact pointer-free summary of TensorRT runtime-config state. TensorRT runtime-config 状态的紧凑无指针摘要。

TensorRtRuntimeCreateDiagnosticSnapshot

Copied no-throw diagnostic snapshot for TensorRT 11 runtime creation. TensorRT 11 runtime 创建过程的复制型 no-throw 诊断快照。

TensorRtRuntimeDeserializationBoundaryPrecheck

Evaluates the pointer-free TensorRT runtime deserialization boundary precheck. 评估 TensorRT runtime deserialization 边界的无裸指针预检。

TensorRtRuntimeDeserializationDependencyDiagnostics

Evaluates dependency diagnostics for TensorRT runtime deserialization without promoting runtime proof. 评估 TensorRT runtime deserialization 的依赖诊断边界，但不提升 runtime proof。

TensorRtRuntimeDiagnosticSnapshot

Captures copied read-only diagnostics for a TensorRT runtime instance. 捕获 TensorRT runtime 实例的复制型只读诊断信息。

TensorRtRuntimeDiagnosticSummary

Compact pointer-free summary for a TensorRT runtime diagnostic snapshot. TensorRT runtime 诊断快照的简短无指针摘要。

TensorRtRuntimeProbeReport

TensorRT runtime staged probe report. TensorRT runtime 分阶段探针报告。

TensorRtRuntimeProbeStage

Result for one TensorRT runtime probe stage. TensorRT runtime 分阶段探针的单阶段结果。

TensorRtSerializationConfig

Wraps TensorRT ISerializationConfig for engine serialization options. 封装 TensorRT ISerializationConfig，用于控制 engine 序列化选项。

TensorRtSerializationConfigSummary

Compact pointer-free summary of TensorRT serialization-config state. TensorRT serialization-config 状态的紧凑无指针摘要。

TensorRtSerializedNetworkWithKernelText

Owns a serialized TensorRT engine plan and the optional kernel text emitted by TensorRT 11. 持有 TensorRT 11 生成的序列化 engine plan，以及可选的 kernel text 输出。

TensorRtSharpInfo

Repository-level metadata for the managed TensorRT assembly. 托管 TensorRT 程序集的仓库级元数据。

TensorRtStreamIoInterfaceInfoDesignGate

Evaluates the pointer-free TensorRT stream reader/writer interface-info design gate. 评估 TensorRT stream reader/writer interface-info 的无裸指针设计门。

TensorRtStreamReader

Owns an immutable native TensorRT IStreamReaderV2 data source. 拥有不可变的原生 TensorRT IStreamReaderV2 数据源。

TensorRtStreamReaderRuntimeSnapshot

Copied, pointer-free diagnostics for a native TensorRT IStreamReaderV2 owner. 原生 TensorRT IStreamReaderV2 所有者的复制型无指针诊断信息。

TensorRtTensor

Represents a TensorRT network tensor handle. 表示一个 TensorRT 网络张量句柄。

TensorRtTensorBindingState

Describes one engine tensor's binding state inside a TensorRT execution context. 描述 TensorRT execution context 中某个 engine tensor 的绑定状态。

TensorRtTensorInfo

Describes one TensorRT input or output tensor. 描述一个 TensorRT 输入或输出 tensor。

TensorRtTimingCache

Managed wrapper around a TensorRT timing cache. TensorRT timing cache 的托管封装。

TensorRtVersionedInterfaceMetadata

Represents copied metadata from a TensorRT versioned interface without retaining its native pointer. 表示从 TensorRT versioned interface 复制出的元数据，不持有其原生指针。

TensorRtWeights

Immutable TensorRT weights payload for layer creation APIs. 用于 layer 创建 API 的不可变 TensorRT weights 负载。

TensorRtWeightsInfo

Describes TensorRT weights metadata without exposing the native weights pointer. 描述 TensorRT weights 的元数据，但不暴露原生 weights 指针。

Structs

TensorRtAlgorithmSnapshotDesignGateResult

Reports algorithm snapshot design status without exposing TensorRT algorithm pointers. 报告 algorithm snapshot 设计状态，不暴露 TensorRT algorithm 指针。

TensorRtAllocatorCallbackOwnerSnapshot

Reports a copied, pointer-free lifecycle snapshot from TensorRtAllocatorCallbackOwner. 表示从 TensorRtAllocatorCallbackOwner 复制出的、无 pointer 的生命周期快照。

TensorRtAllocatorDryRunRequest

Describes one managed allocator dry-run diagnostic request. 描述一次托管 allocator dry-run 诊断请求。

TensorRtAllocatorDryRunResult

Reports the result of an allocator dry-run diagnostic. 表示 allocator dry-run 诊断结果。

TensorRtAllocatorInterfaceInfoDesignGateResult

Reports allocator interface-info design status without exposing allocator pointers. 报告 allocator interface-info 设计状态，不暴露 allocator 指针。

TensorRtAllocatorLedgerSafetyGateResult

Reports copied allocator ledger safety gate diagnostics. 表示复制出的 allocator ledger 安全门禁诊断信息。

TensorRtAllocatorNativeDryRunResult

Reports copied diagnostics from the native allocator owner dry-run C ABI. 表示从 native allocator owner dry-run C ABI 复制出的诊断信息。

TensorRtAllocatorOwnerStateDryRunResult

Reports copied native allocator owner state intent data from the dry-run C ABI. 表示从 dry-run C ABI 复制出的 native allocator owner 状态意图数据。

TensorRtCalibratorMetadataDesignGateResult

Reports INT8 calibrator metadata design status without exposing native calibrator pointers. 报告 INT8 calibrator metadata 设计状态，不暴露原生 calibrator 指针。

TensorRtCallbackOwnerClosureMatrixRow

Reports one callback owner family in the closure matrix. 表示 callback owner 闭环矩阵中的一个 family。

TensorRtDebugListenerAttachDetachDesignGateResult

Reports copied DebugListener attach/detach design diagnostics without exposing native pointers. 中文：该成员报告 DebugListener 无裸指针边界状态，不代表真实 TensorRT 回调运行证明。

TensorRtDebugListenerAttachVTableSafetyGateResult

Reports copied DebugListener attach/vtable safety diagnostics without exposing native pointers. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能替代真实 TensorRT callback runtime proof。

TensorRtDebugListenerBorrowedDebugTensorMetadataRuntimeGateResult

Reports copied borrowed debug tensor metadata runtime gate diagnostics without exposing native pointers. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能作为真实 TensorRT callback runtime proof。

TensorRtDebugListenerBorrowedTensorSafetyGateResult

Reports copied DebugListener borrowed tensor diagnostics without exposing native pointers. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能替代真实 TensorRT callback runtime proof。

TensorRtDebugListenerCallbackOwnerSnapshot

Reports copied diagnostics for the debug-listener callback owner design gate. 表示 debug-listener callback owner 设计门禁复制出的诊断信息。

TensorRtDebugListenerCallbackRequest

Describes one diagnostic request for the future TensorRT debug-listener callback owner. 描述未来 TensorRT debug-listener callback owner 的一次诊断请求。

TensorRtDebugListenerExceptionStatusMappingGateResult

Reports copied DebugListener exception-to-status mapping diagnostics without exposing native pointers. 中文：该成员报告 DebugListener 无裸指针边界状态，不代表真实 TensorRT 回调运行证明。

TensorRtDebugListenerInFlightAccountingGateResult

Reports copied DebugListener in-flight accounting diagnostics without exposing native pointers. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能替代真实 TensorRT callback runtime proof。

TensorRtDebugListenerNativeAttachBridgeShapeGateResult

Reports copied DebugListener native attach bridge shape diagnostics without exposing native pointers. 中文：该成员报告 DebugListener 无裸指针边界状态，不代表真实 TensorRT 回调运行证明。

TensorRtDebugListenerNativeAttachEntryDesignGateResult

Reports copied DebugListener native attach entry design diagnostics without exposing native pointers. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能替代真实 TensorRT callback runtime proof。

TensorRtDebugListenerNativeAttachEntryMinimalSafetyResult

Reports copied DebugListener native attach entry minimal-safety diagnostics without exposing native pointers. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能替代真实 TensorRT callback runtime proof。

TensorRtDebugListenerNativeAttachEntryRuntimeScaffoldResult

Reports copied DebugListener native attach entry runtime scaffold diagnostics without exposing native pointers. 中文：该成员报告 DebugListener 无裸指针边界状态，不代表真实 TensorRT 回调运行证明。

TensorRtDebugListenerNativeAttachNoThrowPreflightResult

Reports DebugListener native attach/no-throw preflight diagnostics without exposing native pointers. 中文：该成员报告 DebugListener 无裸指针边界状态，不代表真实 TensorRT 回调运行证明。

TensorRtDebugListenerNativeDetachBeforeReleaseDesignGateResult

Reports copied DebugListener native detach-before-release design diagnostics without exposing native pointers. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能替代真实 TensorRT callback runtime proof。

TensorRtDebugListenerNativeNoThrowDestructorResult

Reports copied DebugListener native owner no-throw destructor diagnostics without exposing native pointers. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能替代真实 TensorRT callback runtime proof。

TensorRtDebugListenerNativeNoThrowVTableDesignGateResult

Reports copied DebugListener native no-throw vtable design diagnostics without exposing native pointers. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能替代真实 TensorRT callback runtime proof。

TensorRtDebugListenerNativeNoThrowVTableScaffoldGateResult

Reports copied DebugListener native no-throw vtable scaffold diagnostics without exposing native pointers. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能替代真实 TensorRT callback runtime proof。

TensorRtDebugListenerNativeOwnerAddressDesignGateResult

Reports copied DebugListener native owner address design diagnostics without exposing native pointers. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能替代真实 TensorRT callback runtime proof。

TensorRtDebugListenerNativeOwnerLifecycleDryRunResult

Reports copied DebugListener native owner lifecycle dry-run diagnostics without exposing native pointers. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能作为真实 TensorRT callback runtime proof。

TensorRtDebugListenerNativeOwnerLifecycleGateResult

Reports copied DebugListener native owner lifecycle gate diagnostics without exposing native pointers. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能作为真实 TensorRT callback runtime proof。

TensorRtDebugListenerNativeOwnerNonCopyableStorageResult

Reports copied DebugListener native owner non-copyable storage diagnostics without exposing native pointers. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能替代真实 TensorRT callback runtime proof。

TensorRtDebugListenerNativeOwnerStableIdentityResult

Reports copied DebugListener native owner stable identity diagnostics without exposing native pointers. 中文：该成员报告 DebugListener 无裸指针边界状态，不代表真实 TensorRT 回调运行证明。

TensorRtDebugListenerNativeOwnerVTableInstallExperimentResult

Reports copied DebugListener native owner/vtable install experiment diagnostics without exposing native pointers. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能替代真实 TensorRT callback runtime proof。

TensorRtDebugListenerNativeVTableInstallPreflightResult

Reports copied DebugListener native vtable install preflight diagnostics without exposing native pointers. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能作为真实 TensorRT callback runtime proof。

TensorRtDebugListenerNoThrowVTableCallbackStubResult

Reports copied DebugListener no-throw vtable callback-stub diagnostics without exposing native pointers. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能作为真实 TensorRT callback runtime proof。

TensorRtDebugListenerProcessDebugTensorCallbackTrampolineResult

Reports pointer-free DebugListener processDebugTensor callback trampoline diagnostics. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能作为真实 TensorRT callback runtime proof。

TensorRtDebugListenerRealCallbackRuntimeProofResult

Reports the final pointer-free DebugListener real callback runtime proof promotion gate. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能替代真实 TensorRT callback runtime proof。

TensorRtDebugListenerRealNonNullAttachRuntimeSmokeResult

Reports a pointer-free DebugListener non-null attach runtime smoke attempt. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能替代真实 TensorRT callback runtime proof。

TensorRtDebugListenerRuntimeProofAttemptPreflightResult

Reports pointer-free readiness for attempting DebugListener real callback runtime proof work. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能替代真实 TensorRT callback runtime proof。

TensorRtDebugListenerRuntimeProofPrecheckResult

Reports copied DebugListener runtime proof precheck diagnostics. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能作为真实 TensorRT callback runtime proof。

TensorRtDebugListenerRuntimeSnapshot

Reports copied runtime state from a native TensorRT IDebugListener owner. 表示从 native TensorRT IDebugListener owner 复制出的运行时状态。

TensorRtDebugTensorMetadataSnapshot

Reports copied, pointer-free debug tensor metadata used by DebugListener trampoline diagnostics. 该成员提供 DebugListener callback 安全边界的只读诊断信息；不能作为真实 TensorRT callback runtime proof。

TensorRtDimensionExpressionSnapshotDesignGateResult

Reports dimension expression snapshot design status without exposing native expression pointers. 报告 dimension expression snapshot 设计状态，不暴露原生 expression 指针。

TensorRtErrorRecorderDiagnosticsDesignGateResult

Reports copied ErrorRecorder diagnostics design status without exposing native recorder pointers. 报告 ErrorRecorder 已复制诊断的设计状态，不暴露原生 recorder 指针。

TensorRtGpuAllocatorCallbackRequest

Contains copied, pointer-free metadata for one TensorRT GPU allocator callback. 包含一次 TensorRT GPU allocator 回调复制出的无指针元数据。

TensorRtGpuAllocatorRuntimeSnapshot

Reports copied, pointer-free state from a native IGpuAllocator owner. 报告 native IGpuAllocator owner 复制出的无指针状态。

TensorRtInterfaceInfo

Copied TensorRT versioned-interface metadata. 从 TensorRT 复制出的 versioned-interface 元数据。

TensorRtLoggerFinderMetadataDesignGateResult

Reports ILoggerFinder metadata design status without exposing native finder pointers. 报告 ILoggerFinder metadata 设计状态，不暴露原生 finder 指针。

TensorRtOutputAllocatorAttachDetachDesignGateResult

Reports copied OutputAllocator attach/detach design diagnostics without exposing native pointers. 中文：该成员报告 OutputAllocator 无裸指针边界状态，不代表真实 TensorRT 回调运行证明。

TensorRtOutputAllocatorCallbackOwnerSnapshot

Reports copied diagnostics for the output allocator callback owner design gate. 表示 output allocator callback owner 设计门禁复制出的诊断信息。

TensorRtOutputAllocatorCallbackRequest

Describes copied metadata for one TensorRT output allocator callback. 描述一次 TensorRT output allocator 回调复制出的元数据。

TensorRtOutputAllocatorRuntimeProofPrecheckResult

Reports copied OutputAllocator runtime proof precheck diagnostics. 该成员提供 OutputAllocator callback 安全边界的只读诊断信息；不会暴露 native output buffer 指针。

TensorRtOutputAllocatorRuntimeSnapshot

Reports pointer-free state copied from a native TensorRT output allocator owner. 表示从 native TensorRT output allocator owner 复制出的无指针运行状态。

TensorRtOutputBufferOwnershipSafetyGateResult

Reports copied OutputAllocator output-buffer ownership diagnostics without exposing native pointers. 该成员提供 OutputAllocator 输出缓冲区所有权边界的只读诊断信息；不会暴露 native 指针。

TensorRtPluginCreatorV3MetadataDesignGateResult

Reports PluginCreatorV3 metadata design status without exposing plugin creator pointers. 报告 PluginCreatorV3 metadata 设计状态，不暴露 plugin creator 指针。

TensorRtPluginV3InterfaceMetadata

Copied versioned-interface metadata for a PluginV3 object or capability. PluginV3 对象或 capability 的 versioned-interface 元数据副本。

TensorRtProfilerInterfaceMetadataSnapshot

Pointer-free aggregate of profiler interface metadata probes. profiler interface metadata probe 的无指针聚合副本。

TensorRtProgressMonitorDiagnosticResult

Result returned by a native progress monitor diagnostic emission. native progress monitor 诊断触发返回的结果。

TensorRtProgressMonitorEvent

A copied TensorRT progress monitor event. 从 TensorRT 复制出的 progress monitor 事件。

TensorRtRefitEntry

Describes a TensorRT layer/role pair that can be refitted or is still missing. 描述一个可 refit 或仍缺失的 TensorRT layer/role 组合。

TensorRtRnnV2BorrowedStateDesignGateResult

Reports RNNv2 borrowed-state design status without exposing native pointers. 报告 RNNv2 borrowed-state 设计状态，不暴露原生指针。

TensorRtRuntimeDeserializationBoundaryPrecheckResult

Reports runtime deserialization boundary status without exposing native engine pointers. 报告 runtime deserialization 边界状态，不暴露原生 engine 指针。

TensorRtRuntimeDeserializationDependencyDiagnosticsResult

Reports runtime deserialization dependency diagnostics without exposing native pointers. 报告 runtime deserialization 依赖诊断，不暴露 native 指针。

TensorRtStreamIoInterfaceInfoDesignGateResult

Reports stream IO interface-info design status without exposing native stream handles. 报告 stream IO interface-info 设计状态，不暴露原生 stream handle。

TensorRtTimingCacheValue

Represents one TensorRT timing-cache entry value. 表示一个 TensorRT timing cache 条目值。

Enums

TensorRtActivationType

Represents TensorRT TensorRtActivationType values. 表示 TensorRT TensorRtActivationType 枚举值。

TensorRtApiLanguage

TensorRT versioned-interface implementation language. TensorRT versioned-interface 的实现语言。

TensorRtAttentionIoForm

Describes TensorRT attention input/output tensor packing. 描述 TensorRT attention 输入/输出张量排布方式。

TensorRtAttentionNormalizationOperation

Describes the normalization operation used inside TensorRT attention. 描述 TensorRT attention 内部使用的归一化操作。

TensorRtBoundingBoxFormat

Describes the coordinate encoding used by a TensorRT NMS layer. 描述 TensorRT NMS 层使用的边界框坐标编码方式。

TensorRtBuilderFlag

Represents TensorRT TensorRtBuilderFlag values. 表示 TensorRT TensorRtBuilderFlag 枚举值。

TensorRtBuilderFlags

Represents a TensorRT builder flag bitmask. 表示 TensorRT builder flag 位掩码。

TensorRtCausalMaskKind

Describes TensorRT attention causal-mask alignment. 描述 TensorRT attention 因果 mask 的对齐方向。

TensorRtCollectiveOperation

Selects the collective communication primitive for a TensorRT 11 DistCollective layer. 选择 TensorRT 11 DistCollective 层的集合通信原语。

TensorRtCumulativeOperation

Selects the TensorRT cumulative operation. 选择 TensorRT cumulative 层的累计运算。

TensorRtDataType

Represents TensorRT TensorRtDataType values. 表示 TensorRT TensorRtDataType 枚举值。

TensorRtDeviceType

Represents TensorRT TensorRtDeviceType values. 表示 TensorRT TensorRtDeviceType 枚举值。

TensorRtDistributedReduceOperation

Selects the distributed reduction operation for a TensorRT 11 DistCollective layer. 选择 TensorRT 11 DistCollective 层使用的分布式归约操作。

TensorRtElementWiseOperation

Represents TensorRT TensorRtElementWiseOperation values. 表示 TensorRT TensorRtElementWiseOperation 枚举值。

TensorRtEngineCapability

Represents TensorRT TensorRtEngineCapability values. 表示 TensorRT TensorRtEngineCapability 枚举值。

TensorRtEngineStat

Selects an engine statistic reported by TensorRT. 选择 TensorRT 返回的 engine 统计项。

TensorRtExecutionContextAllocationStrategy

Selects how TensorRT 11 allocates execution-context device memory. 选择 TensorRT 11 execution context 的设备内存分配策略。

TensorRtFillOperation

Represents TensorRT TensorRtFillOperation values. 表示 TensorRT TensorRtFillOperation 枚举值。

TensorRtGatherMode

Selects the TensorRT gather semantics. 选择 TensorRT gather 层的索引语义。

TensorRtGpuAllocatorAttachmentTarget

Identifies the TensorRT object currently borrowing a GPU allocator owner. 标识当前借用 GPU allocator owner 的 TensorRT 对象。

TensorRtGpuAllocatorCallbackKind

Identifies an IGpuAllocator callback operation. 标识 IGpuAllocator 回调操作。

TensorRtHardwareCompatibilityLevel

Describes TensorRT engine hardware-compatibility requirements. 描述 TensorRT engine 的硬件兼容性要求。

TensorRtIOMode

Represents TensorRT TensorRtIOMode values. 表示 TensorRT TensorRtIOMode 枚举值。

TensorRtInterpolationMode

Selects the TensorRT interpolation algorithm for resize and grid-sample style layers. 选择 TensorRT resize / grid-sample 等层使用的插值算法。

TensorRtKvCacheMode

Describes the TensorRT KV cache update mode. 描述 TensorRT KV cache update 模式。

TensorRtLayerInformationFormat

Represents TensorRT TensorRtLayerInformationFormat values. 表示 TensorRT TensorRtLayerInformationFormat 枚举值。

TensorRtLayerType

Represents TensorRT TensorRtLayerType values. 表示 TensorRT TensorRtLayerType 枚举值。

TensorRtLogSeverity

Severity values used by TensorRT logger callbacks. TensorRT logger 回调使用的严重级别。

TensorRtLoopOutputKind

Selects the output semantics of a TensorRT loop output layer. 选择 TensorRT loop output 层的输出语义。

TensorRtMatrixOperation

Represents TensorRT TensorRtMatrixOperation values. 表示 TensorRT TensorRtMatrixOperation 枚举值。

TensorRtMemoryPoolType

Represents TensorRT TensorRtMemoryPoolType values. 表示 TensorRT TensorRtMemoryPoolType 枚举值。

TensorRtMoEActivationType

Describes the activation used by a TensorRT MoE layer. 描述 TensorRT MoE 层使用的激活函数。

TensorRtNativeDependencySource

Identifies how a native dependency path was discovered by ProbeNativeDependencies(TensorRtApiLine). 标识 ProbeNativeDependencies(TensorRtApiLine) 发现 native 依赖路径的方式。

TensorRtNetworkDefinitionCreationFlags

Represents TensorRT TensorRtNetworkDefinitionCreationFlags values. 表示 TensorRT TensorRtNetworkDefinitionCreationFlags 枚举值。

TensorRtOnnxParserFlag

Identifies an individual ONNX parser flag. 标识单个 ONNX parser 标志。

TensorRtOnnxParserFlags

Represents a bitmask of ONNX parser flags. 表示 ONNX parser 标志位掩码。

TensorRtOptimizationProfileSelector

Represents TensorRT TensorRtOptimizationProfileSelector values. 表示 TensorRT TensorRtOptimizationProfileSelector 枚举值。

TensorRtOutputAllocatorCallbackKind

Identifies an IOutputAllocator callback operation. 标识一次 IOutputAllocator 回调操作。

TensorRtPaddingMode

Represents TensorRT TensorRtPaddingMode values. 表示 TensorRT TensorRtPaddingMode 枚举值。

TensorRtPluginFieldType

TensorRT plugin field data type reported by plugin creators. TensorRT plugin creator 报告的字段数据类型。

TensorRtPluginFormatCapabilityKind

Identifies a pointer-free plugin format capability snapshot. 标识无指针 plugin 格式能力快照。

TensorRtPluginRegistrySource

Identifies the TensorRT registry source used for a plugin creator inventory. 标识 plugin creator inventory 使用的 TensorRT registry 来源。

TensorRtPoolingType

Represents TensorRT TensorRtPoolingType values. 表示 TensorRT TensorRtPoolingType 枚举值。

TensorRtPreviewFeature

Selects TensorRT builder preview features. Some values are valid only on specific TensorRT major versions. 选择 TensorRT builder 预览特性；部分取值仅在特定 TensorRT 大版本中有效。

TensorRtProfilingVerbosity

Represents TensorRT TensorRtProfilingVerbosity values. 表示 TensorRT TensorRtProfilingVerbosity 枚举值。

TensorRtProgressMonitorEventKind

TensorRT progress monitor event kinds. TensorRT progress monitor 事件类型。

TensorRtQuantizationFlag

Selects TensorRT 8/10 quantization calibration behavior. 选择 TensorRT 8/10 quantization calibration 行为。

TensorRtQuantizationFlags

Represents a TensorRT 8/10 quantization flag bitmask. 表示 TensorRT 8/10 quantization flag 位掩码。

TensorRtReduceOperation

Represents TensorRT TensorRtReduceOperation values. 表示 TensorRT TensorRtReduceOperation 枚举值。

TensorRtResizeCoordinateTransformation

Represents TensorRT TensorRtResizeCoordinateTransformation values. 表示 TensorRT TensorRtResizeCoordinateTransformation 枚举值。

TensorRtResizeMode

Represents TensorRT TensorRtResizeMode values. 表示 TensorRT TensorRtResizeMode 枚举值。

TensorRtResizeRoundMode

Represents TensorRT TensorRtResizeRoundMode values. 表示 TensorRT TensorRtResizeRoundMode 枚举值。

TensorRtResizeSelector

Represents TensorRT TensorRtResizeSelector values. 表示 TensorRT TensorRtResizeSelector 枚举值。

TensorRtRnnDirection

Represents TensorRT 8 RNNv2 direction modes. 表示 TensorRT 8 RNNv2 方向模式。

TensorRtRnnGateType

Represents an individual TensorRT 8 RNNv2 gate. 表示 TensorRT 8 RNNv2 单个门类型。

TensorRtRnnInputMode

Represents TensorRT 8 RNNv2 input modes. 表示 TensorRT 8 RNNv2 输入模式。

TensorRtRnnOperation

Represents TensorRT 8 RNNv2 operation kinds. 表示 TensorRT 8 RNNv2 运算类型。

TensorRtRuntimePlatform

Selects TensorRT 10.x cross-platform runtime target. 选择 TensorRT 10.x 跨平台 runtime 目标。

TensorRtSampleMode

Controls how TensorRT samples out-of-bounds coordinates. 控制 TensorRT 对越界坐标的采样策略。

TensorRtScaleMode

Represents TensorRT TensorRtScaleMode values. 表示 TensorRT TensorRtScaleMode 枚举值。

TensorRtScatterMode

Selects the TensorRT scatter semantics. 选择 TensorRT scatter 层的写入语义。

TensorRtSerializationFlag

Identifies TensorRT 11 serialization flags. 标识 TensorRT 11 serialization config 的单个标志。

TensorRtSerializationFlags

Represents TensorRT 11 serialization flags as a bitmask. 以位掩码形式表示 TensorRT 11 serialization flags。

TensorRtSliceMode

Represents TensorRT TensorRtSliceMode values. 表示 TensorRT TensorRtSliceMode 枚举值。

TensorRtStreamSeekPosition

Identifies the origin used by the most recent native stream seek. 标识最近一次原生流定位使用的基准位置。

TensorRtTacticSources

Represents TensorRT TensorRtTacticSources values. 表示 TensorRT TensorRtTacticSources 枚举值。

TensorRtTempfileControlFlag

Identifies TensorRT runtime temporary-file control flags. 标识 TensorRT runtime 临时文件控制标志。

TensorRtTempfileControlFlags

Represents TensorRT runtime temporary-file control flags as a bitmask. 以位掩码形式表示 TensorRT runtime 临时文件控制标志。

TensorRtTensorFormat

Represents TensorRT TensorRtTensorFormat values. 表示 TensorRT TensorRtTensorFormat 枚举值。

TensorRtTensorFormats

Represents TensorRT TensorRtTensorFormats values. 表示 TensorRT TensorRtTensorFormats 枚举值。

TensorRtTensorLocation

Represents TensorRT TensorRtTensorLocation values. 表示 TensorRT TensorRtTensorLocation 枚举值。

TensorRtTilingOptimizationLevel

Selects TensorRT 11 tiling optimization effort. 选择 TensorRT 11 tiling 优化搜索强度。

TensorRtTopKOperation

Represents TensorRT TensorRtTopKOperation values. 表示 TensorRT TensorRtTopKOperation 枚举值。

TensorRtTripLimitKind

Selects how TensorRT limits loop iteration count. 选择 TensorRT 如何限制循环迭代次数。

TensorRtUnaryOperation

Represents TensorRT TensorRtUnaryOperation values. 表示 TensorRT TensorRtUnaryOperation 枚举值。

TensorRtWeightsRole

Identifies how TensorRT uses a weight tensor during refitting. 标识 TensorRT 在 refit 过程中如何使用某个权重张量。

Delegates

TensorRtAllocatorDryRunHandler

Handles allocator dry-run diagnostics. 处理 allocator dry-run 诊断。

TensorRtDebugListenerHandler

Handles one TensorRT debug-tensor notification using copied, pointer-free metadata. 使用复制且不含指针的元数据处理一次 TensorRT debug-tensor 通知。

TensorRtGpuAllocatorHandler

Handles copied GPU allocator metadata and approves or rejects allocation/reallocation requests. 处理复制后的 GPU allocator 元数据，并批准或拒绝分配、重分配请求。

TensorRtLogHandler

Receives TensorRT logger messages copied across the native boundary. 接收从 native 边界复制过来的 TensorRT logger 消息。

TensorRtOutputAllocatorHandler

Handles copied metadata from a native TensorRT output allocator. 处理 native TensorRT output allocator 复制出的元数据。

TensorRtProfilerHandler

Receives TensorRT layer profiling records copied across the native boundary. 接收从 native 边界复制过来的 TensorRT layer profiling 记录。

TensorRtProgressMonitorHandler

Receives TensorRT progress monitor events copied across the native boundary. 接收从 native 边界复制过来的 TensorRT progress monitor 事件。