Table of Contents

Class OutOfProcessEngineOptions

Namespace
InferenceEngine.Core
Assembly
InferenceEngine.Core.dll
public sealed class OutOfProcessEngineOptions
Inheritance
OutOfProcessEngineOptions
Inherited Members

Properties

EngineId

Consumer-defined id identifying which engine the worker should construct.

public string EngineId { get; init; }

Property Value

string

EngineOptions

In-process engine options mirrored to the worker (model path, GPU toggle, warmup). OnSessionInitialized does not cross the boundary; the proxy mirrors EngineInfo from the worker's Load response and fires the callback on the host via BaseInferenceEngine<TInput, TOutput>.

public InferenceEngineOptions EngineOptions { get; init; }

Property Value

InferenceEngineOptions

InferenceTimeout

Timeout for a single predict round-trip.

public TimeSpan InferenceTimeout { get; init; }

Property Value

TimeSpan

StartupTimeout

Timeout for the worker to start, handle load, and emit its EngineInfo. The first MIGraphX program compile can take ~85s; default is generous.

public TimeSpan StartupTimeout { get; init; }

Property Value

TimeSpan

WorkerArguments

Arguments appended after WorkerExecutablePath to enter the worker mode. Default is ["--worker", "inference"]; match the consumer's Program.cs entry point. A list (not a single string) avoids fragility with arguments containing spaces.

public IReadOnlyList<string> WorkerArguments { get; init; }

Property Value

IReadOnlyList<string>

WorkerEnvironment

Environment variables applied to the WORKER process only (e.g. HSA_OVERRIDE_GFX_VERSION=10.3.0). Never applied to the host (which must stay GL-free of ROCm/comgr). Inherits the host's environment by default; these augment/override it.

public IReadOnlyDictionary<string, string> WorkerEnvironment { get; init; }

Property Value

IReadOnlyDictionary<string, string>

WorkerExecutablePath

Absolute path to the consumer's worker executable (the same app, launched with WorkerArguments so it enters InferenceWorkerHost).

public required string WorkerExecutablePath { get; init; }

Property Value

string