Brok's ForgeAI Engineering
Docs
GitHubHome
All documentation

Introduction

  • What is Broks Forge?
  • The AI Engineering Operating System
  • Getting Started
  • The Five Layers

Core Concepts

  • Core Concepts
  • Engineering Intelligence
  • Engineering Memory
  • Knowledge
  • Why Observability Is Not Enough
  • Deterministic Engineering Reasoning

Capabilities

  • Registry
  • AI Git
  • Forge Graph
  • Execution Graph & Failure Graph
  • Evolution
  • Brok — the Engineering Partner
  • Root Cause Explorer
  • Evaluations & Metrics

Working With Broks Forge

  • The Engineering Workflow
  • Examples
  • Best Practices

Comparisons

  • Comparisons Overview
  • Broks Forge vs LangFuse
  • Broks Forge vs LangSmith
  • Broks Forge vs Promptfoo
  • Broks Forge vs Helicone
  • Broks Forge vs Weights & Biases

Developer Documentation

  • Architecture Overview
  • Data Model
  • REST API
  • Module Structure
  • Extension Points
  • Developer Setup & Build
  • Engineering Principles

Reference

  • FAQ
  • Glossary

Engineering Handbook

  • Master Architecture
  • Engineering Handbook
  • Developer Guide
  • Project Rules
  • Coding Standards
  • API Guidelines
  • Security
  • Error Handling
  • Testing Strategy
  • Performance
  • Deployment
  • Contributing
  • Roadmap

Documentation

Everything needed to understand Broks Forge without reading the source: what an AI Engineering Operating System is, how each capability works, how it compares with adjacent tools, and how to build on it.

Start hereRun it locally

Introduction

What Broks Forge is, the category it belongs to, and how to run it.

What is Broks Forge?

The canonical answer: an AI Engineering Operating System that records the engineering act behind an AI system and reasons over it.

The AI Engineering Operating System

The category explained: the problems AI teams face, why observability is not enough, and what an operating system for AI engineering has to model.

Getting Started

Run the stack, register your first agent, dataset and prompt, evaluate them, and read the engineering record that results.

The Five Layers

Forge Kernel, Registry, AI Git, Forge Graph and Engineering Applications — what each layer owns and why the order matters.

Core Concepts

The object model and the ideas the whole platform is built on.

Core Concepts

Artifacts, revisions, evaluations, runs, and the derived reasoning objects — Observation, Claim, Decision, Evidence and Knowledge.

Engineering Intelligence

How Broks Forge derives observations, claims, decisions, evidence and knowledge from real engineering work, without anyone writing them down.

Engineering Memory

Why a system that remembers why things are the way they are behaves differently from one that only remembers what happened.

Knowledge

Durable engineering facts that emerge from decisions and evidence — never authored, never fabricated, always traceable.

Why Observability Is Not Enough

Traces answer what happened. Engineering questions are about why, what changed, what it means and what to do — a different data model.

Deterministic Engineering Reasoning

Why the reasoning layer is a deterministic engine over real records rather than a language model, and what that guarantees.

Capabilities

Each surface, what question it answers, and how it works.

Registry

One catalog of every engineering artifact and every piece of knowledge derived from it — discovery in one place, not per module.

AI Git

Version control for engineering reasoning: revisions, promotions, rollbacks and the rationale behind each change.

Forge Graph

Your AI organization as a connected system — artifacts, their real relationships, and reasoning layered on top of them.

Execution Graph & Failure Graph

The runtime path of a single evaluation run, reconstructed from its own telemetry — and the same graph narrowed to where the chain broke.

Evolution

Lineage and blast radius: what an artifact depends on, what depends on it, and what a change here would affect.

Brok — the Engineering Partner

Ask engineering questions in plain English and get answers read from your own record, each one declaring how it is known.

Root Cause Explorer

The Engineering Investigation Workspace: a chronology, a cause at four depths, and every chain of evidence behind a failure.

Evaluations & Metrics

Reproducible measurement: pinned configurations, real runs, the metric catalog and the failure classifier behind them.

Working With Broks Forge

The engineering loop, worked examples and the practices that make it pay off.

The Engineering Workflow

Problem → Execution → Evidence → Knowledge → Decision → Revision → Promotion → Deployment → Learning, end to end.

Examples

Four worked scenarios: a failing deployment, a prompt regression, an unexplained cost rise, and a promotion nobody can defend.

Best Practices

How to get a trustworthy engineering record: what to version, what to evaluate, and what to record a reason for.

Comparisons

How Broks Forge differs in scope and philosophy from adjacent tools. Factual, not competitive.

Comparisons Overview

Where Broks Forge sits relative to tracing, evaluation, gateway and experiment-tracking tools — and where it overlaps.

Broks Forge vs LangFuse

Tracing and evaluation for LLM apps, compared with an engineering record and reasoning layer.

Broks Forge vs LangSmith

The LangChain-native observability and evaluation suite, compared with a framework-agnostic engineering OS.

Broks Forge vs Promptfoo

A developer-first prompt testing CLI, compared with a persistent, multi-user engineering record.

Broks Forge vs Helicone

An LLM gateway and observability proxy, compared with a platform that reasons about engineering decisions.

Broks Forge vs Weights & Biases

Experiment tracking built for model training, compared with engineering intelligence for AI systems in production.

Developer Documentation

Architecture, the data model, the REST API, extension points and how to build the project.

Architecture Overview

The system in one page: Spring Boot modules, the Next.js app, the derivation pipeline and where each layer lives.

Data Model

What is stored versus what is derived — the persisted tables, the composite ids, and the reasoning objects computed on read.

REST API

Conventions, authentication, tenancy, pagination and errors — plus the endpoints for every capability.

Module Structure

How the backend and frontend are organised, and the rules a new module has to follow.

Extension Points

Adding a provider, a metric, a Brok intent, a brief or an investigation cause — the seams designed to be extended.

Developer Setup & Build

Prerequisites, running the stack, the test suites, and the build commands that gate a change.

Engineering Principles

The rules the codebase is held to: one product, evolve don't duplicate, derive don't store, never fabricate.

Reference

Terminology and the questions people ask first.

FAQ

Straight answers about scope, cost, self-hosting, model support, data handling and maturity.

Glossary

Every term Broks Forge uses, defined once and used consistently across the product and the docs.

Engineering Handbook

The repository's own engineering documents, published unedited — the rules this project is actually built under.

Master Architecture

The full internal architecture reference.

Engineering Handbook

How the team works: standards, review and delivery.

Developer Guide

Day-to-day development reference.

Project Rules

Non-negotiable rules for changes to this codebase.

Coding Standards

Language-level conventions for Java and TypeScript.

API Guidelines

REST conventions every endpoint follows.

Security

Authentication, authorization, tenancy and credential handling.

Error Handling

How failures are represented and surfaced.

Testing Strategy

What is tested, at which level, and why.

Performance

Performance budgets and the practices that hold them.

Deployment

Running Broks Forge in a real environment.

Contributing

How to propose and land a change.

Roadmap

What exists today and what is planned.