Overview / Help and runbooks
Help and runbooks
Written for MARS staff and student interns who will run and extend the materials database after handover.
How the data flows
- Extract. An agent on or near each machine copies new or changed files into the landing container in Azure Blob Storage. Files are never edited.
- Bronze. Every landed file is recorded with its hash and version; text files are stored line by line exactly as written.
- Silver. Each source is parsed with a fixed schema. A value that fails its type check sends the row to quarantine with the reason.
- Gold. Parts are the spine. ION runs tie print jobs, oven and furnace cycles, inspection reports and images to each part.
- Checks. Corrupt files, missing reports, incomplete cycles and unlinked images raise alerts that clear themselves when fixed.
Runbooks
| Runbook | Use when |
|---|---|
| RB-01 Re-export a machine file | An alert says a file is corrupt or cut off |
| RB-02 Add a new machine source | Bringing on a source from the scheduled list |
| RB-03 Map an unlinked sample ID | An image or report names a sample that is not in ION |
| RB-04 Rerun a pipeline run | A run failed or a source was late |
| RB-05 Grant or remove access | New staff, new interns, end of semester |
| RB-06 Change a column or table | A researcher needs a new field in gold |
Training sessions
| Session | Audience | Materials |
|---|---|---|
| 1. Finding a part's full history | Researchers, interns | Slides, recording, exercise |
| 2. Reading oven and furnace cycles | Researchers, technicians | Slides, recording |
| 3. Alerts, quarantine and re-exports | Data administrators | Runbooks RB-01, RB-04, recording |
| 4. Adding a machine source | Data administrators, interns | Walkthrough notebook, recording |
| 5. Querying gold tables from notebooks | Researchers, interns | Notebook with worked queries |
Definitions
- Coverage %
- Readings loaded for a cycle divided by the minutes between its ION start and completion.
- Soak deviation
- Largest difference between actual and setpoint while the program holds its peak temperature.
- Mass gain
- Mass after pyrolysis divided by mass before infiltration, minus one, from the values recorded in ION.
- Quarantine
- Rows that failed a type check. Held with the reason until a corrected file replaces them.
- Unlinked image
- An image whose sample ID does not match a part serial in ION.
Data as of pipeline run R-20261105-0200, finished 11/05/2026 02:00 Mountain. Tables: mars.gold and mars.ops.