Table of Contents

Class TensorRtEngineDeploymentSummary

Namespace
JYPPX.TensorRtSharp
Assembly
JYPPX.TensorRtSharp.dll

Compact pointer-free summary of TensorRT engine deployment metadata. TensorRT engine deployment 元数据的紧凑无指针摘要。

public sealed class TensorRtEngineDeploymentSummary
Inheritance
TensorRtEngineDeploymentSummary
Inherited Members

Properties

AuxiliaryStreamCount

Gets copied auxiliary stream count. 获取已复制 auxiliary stream 数量。

public int AuxiliaryStreamCount { get; }

Property Value

int

CanDeleteDeferredRecord

Gets whether deferred records can be deleted because of this summary. 获取是否可因该摘要删除 deferred 记录。

public bool CanDeleteDeferredRecord { get; }

Property Value

bool

CanPromoteRuntimeProof

Gets whether this summary can be promoted as runtime proof. 获取该摘要是否可晋级为 runtime proof。

public bool CanPromoteRuntimeProof { get; }

Property Value

bool

CopiedProfileTensorValueCount

Gets copied profile tensor-value snapshot count. 获取已复制 profile tensor-value snapshot 数量。

public int CopiedProfileTensorValueCount { get; }

Property Value

int

CopiedTensorCount

Gets copied tensor metadata count. 获取已复制 tensor metadata 数量。

public int CopiedTensorCount { get; }

Property Value

int

CopiedTensorCountMatchesReportedIOTensorCount

Gets whether copied tensor metadata covers the reported I/O tensor count. 获取已复制 tensor metadata 是否覆盖报告的 I/O tensor 数量。

public bool CopiedTensorCountMatchesReportedIOTensorCount { get; }

Property Value

bool

DeviceMemorySizeInBytes

Gets copied base device-memory requirement. 获取已复制基础 device memory 需求。

public ulong DeviceMemorySizeInBytes { get; }

Property Value

ulong

DeviceMemorySizeV2InBytes

Gets copied V2 device-memory requirement. 获取已复制 V2 device memory 需求。

public ulong DeviceMemorySizeV2InBytes { get; }

Property Value

ulong

DiagnosticCount

Gets diagnostic count collected while building the snapshot. 获取构建快照时收集的诊断数量。

public int DiagnosticCount { get; }

Property Value

int

EngineName

Gets the copied engine name. 获取已复制 engine 名称。

public string EngineName { get; }

Property Value

string

IOTensorCount

Gets the TensorRT-reported I/O tensor count. 获取 TensorRT 报告的 I/O tensor 数量。

public int IOTensorCount { get; }

Property Value

int

IsRefittable

Gets whether TensorRT reported the engine as refittable. 获取 TensorRT 是否报告 engine 可 refit。

public bool IsRefittable { get; }

Property Value

bool

LayerCount

Gets the TensorRT-reported layer count. 获取 TensorRT 报告的 layer 数量。

public int LayerCount { get; }

Property Value

int

OptimizationProfileCount

Gets the TensorRT-reported optimization profile count. 获取 TensorRT 报告的 optimization profile 数量。

public int OptimizationProfileCount { get; }

Property Value

int

PointerFreeCopiedSummary

Gets whether this summary is copied and pointer-free. 获取该摘要是否为复制型且无指针逃逸。

public bool PointerFreeCopiedSummary { get; }

Property Value

bool

ProfileDeviceMemorySizeInBytes

Gets copied profile-specific device-memory requirement. 获取已复制 profile-specific device memory 需求。

public ulong ProfileDeviceMemorySizeInBytes { get; }

Property Value

ulong

ProfileDeviceMemorySizeV2InBytes

Gets copied profile-specific V2 device-memory requirement. 获取已复制 profile-specific V2 device memory 需求。

public ulong ProfileDeviceMemorySizeV2InBytes { get; }

Property Value

ulong

ProfileIndex

Gets the optimization profile index used for the source snapshot. 获取源快照使用的 optimization profile 索引。

public int ProfileIndex { get; }

Property Value

int

StreamableWeightsSizeInBytes

Gets copied streamable weights size. 获取已复制可流式权重大小。

public long StreamableWeightsSizeInBytes { get; }

Property Value

long

StrippedWeightsSizeInBytes

Gets copied stripped weights size. 获取已复制 stripped weights 大小。

public long StrippedWeightsSizeInBytes { get; }

Property Value

long

TotalWeightsSizeInBytes

Gets copied total weights size. 获取已复制总权重大小。

public long TotalWeightsSizeInBytes { get; }

Property Value

long

WeightStreamingAutomaticBudgetInBytes

Gets copied automatic weight-streaming budget. 获取已复制自动权重流式加载预算。

public long WeightStreamingAutomaticBudgetInBytes { get; }

Property Value

long

WeightStreamingBudgetV2InBytes

Gets copied weight-streaming budget. 获取已复制权重流式加载预算。

public long WeightStreamingBudgetV2InBytes { get; }

Property Value

long

WeightStreamingScratchMemorySizeInBytes

Gets copied weight-streaming scratch memory size. 获取已复制权重流式加载 scratch memory 大小。

public long WeightStreamingScratchMemorySizeInBytes { get; }

Property Value

long

Methods

ToString()

Formats this summary for smoke output and logs. 将该摘要格式化为 smoke 输出和日志。

public override string ToString()

Returns

string