Local Model Agent

Uses TraceAgentClient with any OpenAI-compatible local model, registers a tool, and records a single traced turn.

Run

Find the local model script in the examples/ folder of the repository and run it with uv run. Set the variables below first.

Environment Variables

Variable	Description
TRACE_AGENT_PROXY_URL	URL for the local model proxy
TRACE_AGENT_TEST_MODEL	Model name to use
TRACE_AGENT_PROXY_TIMEOUT	Connection timeout

When to Use

This is a good fit when you want to validate local model connectivity and ensure that TraceAgent can capture tool calls from a locally-hosted LLM.