Chapter 28 — The Flow Map
What the flow map shows
The Flow Map presents measured links between neighboring layers, grouped by probe domain or subject. Supported views can use domain groups or the model’s experts as their grain. Its signal is a measured link quantity; effective pathways is an effective dimension, not a count of individually traced routes or identified circuits.
Capture and available figures
Flow Map capture is optional and off by default. Enable it in the tracker
with flow_map=FlowMapConfig(enabled=True). It operates within configured
time and memory budgets; a skipped or unavailable frame states its reason.
| Figure | View |
|---|---|
| 10.1 | Signal flow map by subject or domain. |
| 10.2 | Signal difference between two domains. |
| 10.3 | Pathways map. |
| 10.4 | Pathways difference. |
| 10.5 | Effective pathways strip. |
| 10.6 | What reaches the next word piece. |
| 10.7 | Effective pathways and probe loss over training. |
Read each figure's own coverage and availability. Printed reports and Export for your AI also include Flow Map readings where available.
Reading the marks
| Mark | Meaning to retain |
|---|---|
| Link color | The domain identified by the legend. |
| Link thickness | The figure’s stated quantity and scale: signal, signal difference, effective pathways, pathways difference, or signed next-piece contribution. |
| Expert node area | Expert traffic share under the stated coverage. |
| Neutral expert nodes | Model experts, not assigned domains. |
| Uncertainty marks or intervals | A restriction on how precisely the link is read. |
| Shared expert or dense path | A separately labeled architectural component, where present. |
Use the legend and hover readings rather than assigning your own meaning to color or size. A domain is a supplied label; an expert is a model component. Neither identifies a semantic circuit by itself.
Drawn, measured, and absent are different
The Links drawn control limits the displayed share of signal. A link below that drawing threshold can still have been measured. An expert not covered by the recorded subset has a different status from a measured zero. Read the caption naming the experts, grain, and coverage.
Where a figure states that a link is uncertain, preserve its interval. An unbounded or restricted reading is not an exact point value simply because the drawing has a visible midpoint.
Playback and comparisons
The view follows the Bench’s shared training-step controls. Read the measured frame labels, pause or step when inspecting values, and keep computed-frame gaps explicit. Any visual transition is a display behavior, not an additional measurement between recorded frames. Exported data must retain the actual frame and coverage it represents.
For domain differences, use the same pair of domains and the figure’s stated scale. A changed picture can reflect routing as well as internal link structure. Compare node traffic and link readings before proposing that a different computation has appeared.
Interpretation limits
A Flow Map is an instrument view, not a literal wiring photograph. It does not establish causal information flow, a circuit’s identity, or improved generalization. Use it to choose domains, experts, and training intervals for inspection, then test proposed mechanisms with independent evidence.
