Options for configuring the model asset and hardware accelerator.
Signature:
export declare interface UniversalEmbedderBaseOptions
Properties
| Property | Type | Description |
|---|---|---|
| device | GPUDevice | An optional pre-created GPUDevice to use for GPU inference. |
| modelAssetBuffer | Uint8Array | ReadableStreamDefaultReader | The model asset buffer containing the .litertlm file. |
| modelAssetPath | string | The path to the model asset file. |
UniversalEmbedderBaseOptions.device
An optional pre-created GPUDevice to use for GPU inference.
Signature:
device?: GPUDevice;
UniversalEmbedderBaseOptions.modelAssetBuffer
The model asset buffer containing the .litertlm file.
Signature:
modelAssetBuffer?: Uint8Array | ReadableStreamDefaultReader;
UniversalEmbedderBaseOptions.modelAssetPath
The path to the model asset file.
Signature:
modelAssetPath?: string;