作品集清单:出处、可复现性、主张与局限
Agent 辅助工程检查
前置要求
第 89 天掌握台账;已完成的学习项目链。
学习目标
定义每个作品集条目必须满足的清单——主张、证据路径、复现命令、观测结果、成本/授权状态、局限——以已验收项目证据和行业出处格式为据。
操作指引
1. 条目必备字段:{project, claim, evidence_path, verify_command, observed_result, status, limitations}。status 词表固定:verified-local(本机命令已验证)、verified-disposable(一次性环境内已验证)、blocked-awaiting-authorization(需要尚未授予的批准/付费/实时访问)。
2. 已验收证据到条目映射:
- Autograd 项目(工单 17):projects/autograd engine + gradcheck;经 python3 projects/autograd/cli.py forward-backward 与 gradcheck 为 verified-local。
- 可续训预训练(工单 18/19):projects/pretrain/artifacts/run_artifact.json——10 步 CPU smoke,train_loss 4.0316,val_loss 4.0372,7440 参数;verified-local。云 GPU 预训练证据:blocked-awaiting-authorization。
- 真LoRA 机制(工单 20/21):projects/lora/artifacts——loss 4.0976→4.0945、perplexity 60.20→60.01、merge_verified true(仅机制验证);云前后对比:依 comparison_contract.json 为 blocked-awaiting-authorization。
- 可评测 Agent(工单 22/23):projects/agent_learning deterministic-v1 评分器+夹具;verified-local。真实模型评测:依 live_eval_contract.json 为 not-run-awaiting-authorization。
- CI 交付练习(工单 24):scripts/ci_practice_runner.py + tests/engineering/test_ci_practice.py;verified-disposable。
3. 诚实规则(逐字):不得把受阻项升级为已验证;每条主张须引用提交哈希与工件路径;smoke 规模结果不得当作收敛呈现。
4. 模型卡与数据说明书约定了业界期待的局限字段——借鉴其字段,而非抄其文本。
自主演练与记录
起草 checklist.md:列每条目必备 6 字段、3 个 status 值、2 条诚实规则,并标注每个已验收项目对应的 status。
Model Cards(Mitchell 等)与 Datasheets(Gebru 等)给出审阅者期待的出处与局限字段。
# Portfolio checklist
Fields per entry: project, claim, evidence_path, verify_command, observed_result, status, limitations.
Statuses: verified-local (autograd, pretrain smoke, agent fixture, lora mechanics); verified-disposable (CI delivery practice); blocked-awaiting-authorization (cloud pretraining, cloud LoRA comparison, live-model agent eval).
Honesty rules: (1) a blocked item is never relabelled verified; (2) every claim cites commit hash + artifact path; smoke-scale results are never presented as convergence or quality evidence.
清单覆盖全部 6 字段、3 种状态,并正确标注每个已验收项目的已验证与受阻待授权证据。
权威源资源与权利证明
The Turing Way: A Handbook for Reproducible, Ethical and Collaborative Data Science
对应章节 / 时间戳: Reproducible Research chapter: version control, testing, environment capture
验证版本与日期: Zenodo DOI 10.5281/zenodo.3233853, continuously updated (Verified: 2026-10-30)
Community-maintained CC-BY handbook codifying reproducibility checklists (versioned code, environment capture, rerunnable commands); directly defines the Day 90 reproduction-verification and provenance-audit workflow.
Basic version control and command-line familiarity.
The portfolio checklist and verification log schema are authored locally; reproduction commands run without the handbook.
对比候选资源与选型分析 (2)
Concise practices paper; The Turing Way's maintained, checklist-driven coverage of environments and reproducibility is broader and kept current.
Foundational rules list; The Turing Way expands the same rules into actionable checklists used verbatim for the Day 90 verification run.
Model Cards for Model Reporting
对应章节 / 时间戳: Section 4 Model Card Sections (4.1-4.9)
验证版本与日期: FAT* 2019 / arXiv:1810.03993v2 (Verified: 2026-10-30)
Primary standard for structured, transparent model reporting, mandating explicit disclosure of intended uses, evaluation slices, out-of-scope tasks, ethical considerations, and negative results.
Evaluation reporting, demographic and performance slicing, model limitations and caveats.
Complete Model Card Markdown templates, section schemas, and evaluation disclosure checklists are provided in the curriculum.
对比候选资源与选型分析 (2)
Corporate transparency audit index; Mitchell et al. provides the concrete technical artifact specification for individual model releases.
Dataset documentation focus; Mitchell et al. provides the required specification for trained model artifact reporting.