Documentation
Everything needed to understand Broks Forge without reading the source: what an AI Engineering Operating System is, how each capability works, how it compares with adjacent tools, and how to build on it.
Introduction
What Broks Forge is, the category it belongs to, and how to run it.
What is Broks Forge?
The canonical answer: an AI Engineering Operating System that records the engineering act behind an AI system and reasons over it.
The AI Engineering Operating System
The category explained: the problems AI teams face, why observability is not enough, and what an operating system for AI engineering has to model.
Getting Started
Run the stack, register your first agent, dataset and prompt, evaluate them, and read the engineering record that results.
The Five Layers
Forge Kernel, Registry, AI Git, Forge Graph and Engineering Applications — what each layer owns and why the order matters.
Core Concepts
The object model and the ideas the whole platform is built on.
Core Concepts
Artifacts, revisions, evaluations, runs, and the derived reasoning objects — Observation, Claim, Decision, Evidence and Knowledge.
Engineering Intelligence
How Broks Forge derives observations, claims, decisions, evidence and knowledge from real engineering work, without anyone writing them down.
Engineering Memory
Why a system that remembers why things are the way they are behaves differently from one that only remembers what happened.
Knowledge
Durable engineering facts that emerge from decisions and evidence — never authored, never fabricated, always traceable.
Why Observability Is Not Enough
Traces answer what happened. Engineering questions are about why, what changed, what it means and what to do — a different data model.
Deterministic Engineering Reasoning
Why the reasoning layer is a deterministic engine over real records rather than a language model, and what that guarantees.
Capabilities
Each surface, what question it answers, and how it works.
Registry
One catalog of every engineering artifact and every piece of knowledge derived from it — discovery in one place, not per module.
AI Git
Version control for engineering reasoning: revisions, promotions, rollbacks and the rationale behind each change.
Forge Graph
Your AI organization as a connected system — artifacts, their real relationships, and reasoning layered on top of them.
Execution Graph & Failure Graph
The runtime path of a single evaluation run, reconstructed from its own telemetry — and the same graph narrowed to where the chain broke.
Evolution
Lineage and blast radius: what an artifact depends on, what depends on it, and what a change here would affect.
Brok — the Engineering Partner
Ask engineering questions in plain English and get answers read from your own record, each one declaring how it is known.
Root Cause Explorer
The Engineering Investigation Workspace: a chronology, a cause at four depths, and every chain of evidence behind a failure.
Evaluations & Metrics
Reproducible measurement: pinned configurations, real runs, the metric catalog and the failure classifier behind them.
Working With Broks Forge
The engineering loop, worked examples and the practices that make it pay off.
The Engineering Workflow
Problem → Execution → Evidence → Knowledge → Decision → Revision → Promotion → Deployment → Learning, end to end.
Examples
Four worked scenarios: a failing deployment, a prompt regression, an unexplained cost rise, and a promotion nobody can defend.
Best Practices
How to get a trustworthy engineering record: what to version, what to evaluate, and what to record a reason for.
Comparisons
How Broks Forge differs in scope and philosophy from adjacent tools. Factual, not competitive.
Comparisons Overview
Where Broks Forge sits relative to tracing, evaluation, gateway and experiment-tracking tools — and where it overlaps.
Broks Forge vs LangFuse
Tracing and evaluation for LLM apps, compared with an engineering record and reasoning layer.
Broks Forge vs LangSmith
The LangChain-native observability and evaluation suite, compared with a framework-agnostic engineering OS.
Broks Forge vs Promptfoo
A developer-first prompt testing CLI, compared with a persistent, multi-user engineering record.
Broks Forge vs Helicone
An LLM gateway and observability proxy, compared with a platform that reasons about engineering decisions.
Broks Forge vs Weights & Biases
Experiment tracking built for model training, compared with engineering intelligence for AI systems in production.
Developer Documentation
Architecture, the data model, the REST API, extension points and how to build the project.
Architecture Overview
The system in one page: Spring Boot modules, the Next.js app, the derivation pipeline and where each layer lives.
Data Model
What is stored versus what is derived — the persisted tables, the composite ids, and the reasoning objects computed on read.
REST API
Conventions, authentication, tenancy, pagination and errors — plus the endpoints for every capability.
Module Structure
How the backend and frontend are organised, and the rules a new module has to follow.
Extension Points
Adding a provider, a metric, a Brok intent, a brief or an investigation cause — the seams designed to be extended.
Developer Setup & Build
Prerequisites, running the stack, the test suites, and the build commands that gate a change.
Engineering Principles
The rules the codebase is held to: one product, evolve don't duplicate, derive don't store, never fabricate.
Reference
Terminology and the questions people ask first.
Engineering Handbook
The repository's own engineering documents, published unedited — the rules this project is actually built under.
Master Architecture
The full internal architecture reference.
Engineering Handbook
How the team works: standards, review and delivery.
Developer Guide
Day-to-day development reference.
Project Rules
Non-negotiable rules for changes to this codebase.
Coding Standards
Language-level conventions for Java and TypeScript.
API Guidelines
REST conventions every endpoint follows.
Security
Authentication, authorization, tenancy and credential handling.
Error Handling
How failures are represented and surfaced.
Testing Strategy
What is tested, at which level, and why.
Performance
Performance budgets and the practices that hold them.
Deployment
Running Broks Forge in a real environment.
Contributing
How to propose and land a change.
Roadmap
What exists today and what is planned.