gleamunison/llm_types

Shared data vocabulary for the LLM boundary.

Types only — no behaviour. llm.gleam (ability host) and llm_wire.gleam (provider wire codec) both depend on this vocabulary; keeping the data in its own module keeps that dependency acyclic (Gleam has no re-export, so consumers name the module that owns the data).

Types

Completion

</>

pub type Completion {
  Completion(
    content: String,
    model: String,
    input_tokens: Int,
    output_tokens: Int,
  )
}

Constructors

Completion(
  content: String,
  model: String,
  input_tokens: Int,
  output_tokens: Int,
)

LlmError

</>

pub type LlmError {
  TransportError(reason: String)
  HttpError(status: Int, body: String)
  DecodeError(reason: String)
}

Constructors

```
TransportError(reason: String)
```
```
HttpError(status: Int, body: String)
```
```
DecodeError(reason: String)
```

Message

</>

pub type Message {
  Message(role: Role, content: String)
}

Constructors

```
Message(role: Role, content: String)
```

Provider

</>

pub type Provider {
  OpenAI
  Anthropic
}

Constructors

```
OpenAI
```
```
Anthropic
```

ProviderConfig

</>

pub type ProviderConfig {
  ProviderConfig(
    provider: Provider,
    base_url: String,
    api_key: String,
    model: String,
    max_tokens: Int,
    timeout_ms: Int,
    reasoning_effort: String,
  )
}

Constructors

ProviderConfig(
  provider: Provider,
  base_url: String,
  api_key: String,
  model: String,
  max_tokens: Int,
  timeout_ms: Int,
  reasoning_effort: String,
)

Arguments

reasoning_effort: OpenAI-compatible reasoning effort (“low”/“medium”/“high”/“max”). Empty string = omit from the request (provider default).

Role

</>

pub type Role {
  System
  User
  Assistant
}

Constructors

```
System
```
```
User
```
```
Assistant
```