作品集清單:出處、可複現性、主張與局限
Agent 輔助工程檢查
前置要求
第 89 天掌握台帳;已完成的學習專案鏈。
學習目標
定義每個作品集條目必須滿足的清單——主張、證據路徑、複現命令、觀測結果、成本/授權狀態、局限——以已驗收專案證據和業界出處格式為據。
操作指引
1. 條目必備欄位:{project, claim, evidence_path, verify_command, observed_result, status, limitations}。status 詞表固定:verified-local(本機命令已驗證)、verified-disposable(一次性環境內已驗證)、blocked-awaiting-authorization(需要尚未授予的批准/付費/即時存取)。
2. 已驗收證據到條目對映:
- Autograd 專案(工單 17):projects/autograd engine + gradcheck;經 python3 projects/autograd/cli.py forward-backward 與 gradcheck 為 verified-local。
- 可續訓預訓練(工單 18/19):projects/pretrain/artifacts/run_artifact.json——10 步 CPU smoke,train_loss 4.0316,val_loss 4.0372,7440 參數;verified-local。雲 GPU 預訓練證據:blocked-awaiting-authorization。
- 真LoRA 機制(工單 20/21):projects/lora/artifacts——loss 4.0976→4.0945、perplexity 60.20→60.01、merge_verified true(僅機制驗證);雲前後對比:依 comparison_contract.json 為 blocked-awaiting-authorization。
- 可評測 Agent(工單 22/23):projects/agent_learning deterministic-v1 評分器+夾具;verified-local。真實模型評測:依 live_eval_contract.json 為 not-run-awaiting-authorization。
- CI 交付練習(工單 24):scripts/ci_practice_runner.py + tests/engineering/test_ci_practice.py;verified-disposable。
3. 誠實規則(逐字):不得把受阻項升級為已驗證;每條主張須引用提交雜湊與工件路徑;smoke 規模結果不得當作收斂呈現。
4. 模型卡與資料說明書約定了業界期待的局限欄位——借鑑其欄位,而非抄其文本。
自主實作與記錄
起草 checklist.md:列每條目必備 6 欄位、3 個 status 值、2 條誠實規則,並標註每個已驗收專案對應的 status。
Model Cards(Mitchell 等)與 Datasheets(Gebru 等)給出審閱者期待的出處與局限欄位。
# Portfolio checklist
Fields per entry: project, claim, evidence_path, verify_command, observed_result, status, limitations.
Statuses: verified-local (autograd, pretrain smoke, agent fixture, lora mechanics); verified-disposable (CI delivery practice); blocked-awaiting-authorization (cloud pretraining, cloud LoRA comparison, live-model agent eval).
Honesty rules: (1) a blocked item is never relabelled verified; (2) every claim cites commit hash + artifact path; smoke-scale results are never presented as convergence or quality evidence.
清單覆蓋全部 6 欄位、3 種狀態,並正確標註每個已驗收專案的已驗證與受阻待授權證據。
權威來源資源與權利證明
The Turing Way: A Handbook for Reproducible, Ethical and Collaborative Data Science
對應章節 / 時間戳: Reproducible Research chapter: version control, testing, environment capture
驗證版本與日期: Zenodo DOI 10.5281/zenodo.3233853, continuously updated (Verified: 2026-10-30)
Community-maintained CC-BY handbook codifying reproducibility checklists (versioned code, environment capture, rerunnable commands); directly defines the Day 90 reproduction-verification and provenance-audit workflow.
Basic version control and command-line familiarity.
The portfolio checklist and verification log schema are authored locally; reproduction commands run without the handbook.
對比候選資源與選型分析 (2)
Concise practices paper; The Turing Way's maintained, checklist-driven coverage of environments and reproducibility is broader and kept current.
Foundational rules list; The Turing Way expands the same rules into actionable checklists used verbatim for the Day 90 verification run.
Model Cards for Model Reporting
對應章節 / 時間戳: Section 4 Model Card Sections (4.1-4.9)
驗證版本與日期: FAT* 2019 / arXiv:1810.03993v2 (Verified: 2026-10-30)
Primary standard for structured, transparent model reporting, mandating explicit disclosure of intended uses, evaluation slices, out-of-scope tasks, ethical considerations, and negative results.
Evaluation reporting, demographic and performance slicing, model limitations and caveats.
Complete Model Card Markdown templates, section schemas, and evaluation disclosure checklists are provided in the curriculum.
對比候選資源與選型分析 (2)
Corporate transparency audit index; Mitchell et al. provides the concrete technical artifact specification for individual model releases.
Dataset documentation focus; Mitchell et al. provides the required specification for trained model artifact reporting.