Class TensorRtRefitWeightsBuffer

Namespace

JYPPX.TensorRtSharp

Assembly

JYPPX.TensorRtSharp.dll

Keeps TensorRT refit weights pinned while the native refitter may need to read them. 在原生 refitter 可能读取权重期间，保持 TensorRT refit 权重处于 pinned 状态。

public sealed class TensorRtRefitWeightsBuffer : IDisposable

Inheritance

object

TensorRtRefitWeightsBuffer

Implements

IDisposable

Inherited Members

object.Equals(object)

object.Equals(object, object)

object.GetHashCode()

object.GetType()

object.ReferenceEquals(object, object)

object.ToString()

Constructors

TensorRtRefitWeightsBuffer(TensorRtWeights)

Pins a TensorRT weights object for refitter usage. 固定一个 TensorRT 权重对象，以供 refitter 使用。

public TensorRtRefitWeightsBuffer(TensorRtWeights weights)

Parameters

weights TensorRtWeights

The non-empty weights to pin. 要固定的非空权重。

Properties

DataType

Gets the TensorRT data type represented by the pinned weights. 获取 pinned 权重表示的 TensorRT 数据类型。

public TensorRtDataType DataType { get; }

Property Value

TensorRtDataType

ElementCount

Gets the number of TensorRT weight elements. 获取 TensorRT 权重元素数量。

public int ElementCount { get; }

Property Value

int

Methods

Dispose()

Releases the pinned weights. 释放 pinned 权重。

public void Dispose()

FromByteArray(byte[], TensorRtDataType)

Creates a pinned refit buffer from byte-backed INT8 or UINT8 weights. 从 byte 承载的 INT8 或 UINT8 权重创建 pinned refit buffer。

public static TensorRtRefitWeightsBuffer FromByteArray(byte[] values, TensorRtDataType dataType = TensorRtDataType.Int8)

Parameters

values byte[]

The weight values. 权重值。

dataType TensorRtDataType

The TensorRT byte-backed data type. TensorRT byte 承载数据类型。

Returns

TensorRtRefitWeightsBuffer

A pinned refit buffer. pinned refit 缓冲区。

FromInt32Array(int[])

Creates a pinned refit buffer from 32-bit integer weights. 从 32 位整数权重创建 pinned refit buffer。

public static TensorRtRefitWeightsBuffer FromInt32Array(int[] values)

Parameters

values int[]

The weight values. 权重值。

Returns

TensorRtRefitWeightsBuffer

A pinned refit buffer. pinned refit 缓冲区。

FromSingleArray(float[])

Creates a pinned refit buffer from single-precision floating-point weights. 从单精度浮点权重创建 pinned refit buffer。

public static TensorRtRefitWeightsBuffer FromSingleArray(float[] values)

Parameters

values float[]

The weight values. 权重值。

Returns

TensorRtRefitWeightsBuffer

A pinned refit buffer. pinned refit 缓冲区。