修复验证与防复发模板
| 字段 |
值 |
| 版本 |
v1.0 |
| 最后更新 |
2026-07 |
| 使用时机 |
问题修复后回归验证和沉淀时 |
| 填写角色 |
修复 Owner+评测工程师 |
| 下游消费者 |
Regression Set、发布门禁 |
适用场景
用于将 Bad Case 修复动作转化为可验证、可回归、可防复发的长期资产。
字段说明
| 字段 |
说明 |
| source_bad_case |
来源 Bad Case |
| root_cause |
根因 |
| fix_action |
修复动作 |
| verification |
验证方式 |
| regression_asset |
回归资产 |
| monitor |
线上监控 |
| owner |
负责人 |
模板
fix_record:
source_bad_case:
root_cause:
fix_actions:
- action:
layer:
owner:
evidence:
verification:
original_case:
same_cluster_cases:
adjacent_cases:
regression_set:
online_gray:
prevention_assets:
regression_case:
gate_rule:
watch_metric:
runbook:
owner:
review_cycle:
填写示例
fix_record:
source_bad_case: bc_refund_policy_20260708_001
root_cause: RAG Query 未召回会员积分扣回规则
fix_actions:
- action: 增加 Query 实体扩展
layer: RAG
owner: rag_engineer
evidence: Recall@5 恢复
- action: 金额权益问题强制调用退款规则工具
layer: Agent
owner: agent_engineer
evidence: Trace Case 通过
verification:
original_case: pass
same_cluster_cases: 25/27 pass
adjacent_cases: pass
regression_set: pass
online_gray: 48h 稳定
prevention_assets:
regression_case: reg_refund_member_partial_001
gate_rule: refund_policy_high_risk_gate
watch_metric: refund_policy_error_rate
runbook: refund_policy_diagnosis_runbook
owner: ai_quality_refund
review_cycle: monthly
常见误区
| 误区 |
修正方式 |
| 只验证原失败样本 |
同时验证同簇样本、相邻场景和回归集 |
| 修复后不沉淀资产 |
建立 Regression Case、Gate、Watch Metric 和 Runbook |
| 没有线上验证 |
灰度观察相关线上指标 |
| 责任不清 |
每个动作绑定 Owner |