Enums and Constants

This page reflects ZeticMLange iOS 1.10.0.

General Model Types

Type	Values
`ModelMode`	`.RUN_AUTO`, `.RUN_FP32`, `.RUN_QUANTIZED`, `.RUN_SPEED`, `.RUN_ACCURACY`
`APType`	`.CPU`, `.GPU`, `.NPU`, `.NA`
`ModelCacheHandlingPolicy`	`.REMOVE_OVERLAPPING`, `.KEEP_EXISTING`

Target contains backend identifiers used by selected general-model artifacts. Most apps use ModelMode and let backend selection choose the target.

LLM Types

Type	Values
`LLMModelMode`	`.RUN_AUTO`, `.RUN_SPEED`, `.RUN_ACCURACY`
`LLMTarget`	`.LLAMA_CPP`, `.MLLM`
`LLMQuantType`	GGUF quantization variants such as `.GGUF_QUANT_F16`, `.GGUF_QUANT_Q4_K_M`, and `.GGUF_QUANT_Q8_0`
`LLMKVCacheCleanupPolicy`	`.CLEAN_UP_ON_FULL`, `.DO_NOT_CLEAN_UP`
`KVStateStatus`	Status values returned by KV state persistence operations.
`KVStateError`	Error thrown when a KV state operation fails.

`LLMInitOption`

public struct LLMInitOption {
  public let kvCacheCleanupPolicy: LLMKVCacheCleanupPolicy
  public let nCtx: Int
  public let runConfigId: Int64
}

Field	Default	Description
`kvCacheCleanupPolicy`	`.CLEAN_UP_ON_FULL`	In-memory KV-cache behavior when context storage is full.
`nCtx`	`2048`	Requested context size. The runtime may normalize it.
`runConfigId`	`0`	Run configuration id used by compatible LFM-VL packages.

Result Types

Type	Purpose
`LLMNextTokenResult`	Token result returned by `waitForNextToken()`.

Enums and Constants

General Model Types

LLM Types

LLMInitOption

Result Types

Related

On this page

`LLMInitOption`