feat: add sdg training data bridge
CI / validate (push) Successful in 38s

This commit is contained in:
2026-07-21 13:14:52 -05:00
parent f1a8bb0f35
commit 1d683ab380
13 changed files with 933 additions and 1 deletions
+24
View File
@@ -25,6 +25,7 @@ cargo run -- run calculate --payload '{"expression":"2 + 2 * 3"}'
cargo run -- run to_slug --payload '{"text":"Hello, World!"}'
cargo run -- run write_note --payload '{"filename":"hello.txt","content":"hello"}'
scripts/precommit-check.sh
python3 scripts/generate_training_data.py --dry-run
```
`serve` starts:
@@ -112,3 +113,26 @@ Enable the hook after cloning:
```sh
git config core.hooksPath .githooks
```
## SDG Bridge
`scripts/generate_training_data.py` generates instruction-format seed data from current dictionary artifacts.
Dry run:
```sh
python3 scripts/generate_training_data.py --dry-run
```
Local dataset generation:
```sh
python3 scripts/generate_training_data.py \
--dictionary-dir dictionary/ \
--output-dir ../workspace_Data/data/ \
--manifest ../workspace_Data/manifest.llm.json
```
Optional Mimir/Data Designer expansion is enabled only when `--sdg-host`, `--sdg-user`, and `--sdg-key` are supplied. The bridge does not start or restart Mimir inference services.
If remote expansion fails, the timestamped local seed dataset remains in place, `SDG_ERROR.txt` is written in that dataset directory, and the manifest entry is marked `generated_local_remote_failed`.