API reference
The core modules are importable without the CLI dependencies and never import
Harbor. The one module that does, harbor_agents, is a Harbor plugin: Harbor
imports it inside its own process, and no tdb command does.
| Module | Purpose |
|---|---|
schema |
Versioned pydantic models for every artifact |
dataset |
Intake import, canonical dataset, validation |
build |
Canonical dataset to Harbor task directories |
environment |
Shared image pins, Dockerfile context, build/check commands |
providers |
Model providers shared by agents and judges: name, key variable, API host |
judge |
Judge protocol and one judge per provider: AnthropicJudge, OpenaiJudge, XaiJudge, OpencodeGoJudge, plus FakeJudge |
grade |
Deterministic checks, rubric judging, grade outputs |
scoring |
Versioned scoring rules |
agents |
Supported agents: providers, credentials, hosts, closed-book settings |
harbor_agents |
Harbor plugin: the agent classes tdb run launches, with a file-based instruction transport |
run |
job.yaml generation, allowlists, plugin copy, provenance manifest |
canary |
Network canary task |
report |
Aggregation and leaderboards |
provenance |
Digests, versions, git and image identifiers |
trialdesignbench
TrialDesignBench: a thin evaluation framework for AI agents in clinical trial design.
Harbor runs agents; this package owns the task schema, task materialization, grading, scoring, aggregation, and provenance.