Class OutOfProcessEngineOptions
- Namespace
- InferenceEngine.Core
- Assembly
- InferenceEngine.Core.dll
Options for an OutOfProcessBaseInferenceEngine<TInput, TOutput>.
public sealed class OutOfProcessEngineOptions
- Inheritance
-
OutOfProcessEngineOptions
- Inherited Members
Properties
EngineId
Consumer-defined id identifying which engine the worker should construct.
public string EngineId { get; init; }
Property Value
EngineOptions
In-process engine options mirrored to the worker (model path, GPU toggle, warmup). OnSessionInitialized does not cross the boundary; the proxy mirrors EngineInfo from the worker's Load response and fires the callback on the host via BaseInferenceEngine<TInput, TOutput>.
public InferenceEngineOptions EngineOptions { get; init; }
Property Value
InferenceTimeout
Timeout for a single predict round-trip.
public TimeSpan InferenceTimeout { get; init; }
Property Value
StartupTimeout
Timeout for the worker to start, handle load, and emit its EngineInfo.
The first MIGraphX program compile can take ~85s; default is generous.
public TimeSpan StartupTimeout { get; init; }
Property Value
WorkerArguments
Arguments appended after WorkerExecutablePath to enter the worker mode.
Default is ["--worker", "inference"]; match the consumer's Program.cs entry point.
A list (not a single string) avoids fragility with arguments containing spaces.
public IReadOnlyList<string> WorkerArguments { get; init; }
Property Value
WorkerEnvironment
Environment variables applied to the WORKER process only (e.g.
HSA_OVERRIDE_GFX_VERSION=10.3.0). Never applied to the host (which must stay GL-free
of ROCm/comgr). Inherits the host's environment by default; these augment/override it.
public IReadOnlyDictionary<string, string> WorkerEnvironment { get; init; }
Property Value
WorkerExecutablePath
Absolute path to the consumer's worker executable (the same app, launched with WorkerArguments so it enters InferenceWorkerHost).
public required string WorkerExecutablePath { get; init; }