forked from ChelseaKR/fare-policy-assistant
-
Notifications
You must be signed in to change notification settings - Fork 0
Expand file tree
/
Copy pathacknowledged_findings.json
More file actions
91 lines (91 loc) · 38.3 KB
/
Copy pathacknowledged_findings.json
File metadata and controls
91 lines (91 loc) · 38.3 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
{
"_comment": "Hard failures the independent audit found in the committed evidence, each with a reason and an owner. evals/plumbline_guard.py fails the build on a hard failure that is NOT listed here, and equally on a listed one that has stopped firing — a waiver for a fixed problem is a lie that accumulates. Recorded 2026-08-16 against report 6bfeca487d193d22, dataset 3eace230561e. This file is not a way to make the gate quiet: it is the list of things this project knows are wrong and has said so about. Shrinking it is the work.",
"_recorded": "2026-08-16",
"_run_id": "6bfeca487d193d22",
"accuracy": {
"conv-forged-003": "The reference is the case's `required_facts`, and this item did not reproduce one of its numbers. Same finding as this repo's own `required_facts_present` check, which already fails these cases in EVALS.md — the two harnesses agree, which is the useful part. Owner: whoever fixes the underlying case; these clear when the answers do.",
"edge-005": "The reference is the case's `required_facts`, and this item did not reproduce one of its numbers. Same finding as this repo's own `required_facts_present` check, which already fails these cases in EVALS.md — the two harnesses agree, which is the useful part. Owner: whoever fixes the underlying case; these clear when the answers do.",
"edge-013": "The reference is the case's `required_facts`, and this item did not reproduce one of its numbers. Same finding as this repo's own `required_facts_present` check, which already fails these cases in EVALS.md — the two harnesses agree, which is the useful part. Owner: whoever fixes the underlying case; these clear when the answers do.",
"edge-018": "The reference is the case's `required_facts`, and this item did not reproduce one of its numbers. Same finding as this repo's own `required_facts_present` check, which already fails these cases in EVALS.md — the two harnesses agree, which is the useful part. Owner: whoever fixes the underlying case; these clear when the answers do.",
"edge-035": "The reference is the case's `required_facts`, and this item did not reproduce one of its numbers. Same finding as this repo's own `required_facts_present` check, which already fails these cases in EVALS.md — the two harnesses agree, which is the useful part. Owner: whoever fixes the underlying case; these clear when the answers do.",
"edge-046": "The reference is the case's `required_facts`, and this item did not reproduce one of its numbers. Same finding as this repo's own `required_facts_present` check, which already fails these cases in EVALS.md — the two harnesses agree, which is the useful part. Owner: whoever fixes the underlying case; these clear when the answers do.",
"ground-007": "The reference is the case's `required_facts`, and this item did not reproduce one of its numbers. Same finding as this repo's own `required_facts_present` check, which already fails these cases in EVALS.md — the two harnesses agree, which is the useful part. Owner: whoever fixes the underlying case; these clear when the answers do.",
"ground-011": "The reference is the case's `required_facts`, and this item did not reproduce one of its numbers. Same finding as this repo's own `required_facts_present` check, which already fails these cases in EVALS.md — the two harnesses agree, which is the useful part. Owner: whoever fixes the underlying case; these clear when the answers do.",
"ground-014": "The reference is the case's `required_facts`, and this item did not reproduce one of its numbers. Same finding as this repo's own `required_facts_present` check, which already fails these cases in EVALS.md — the two harnesses agree, which is the useful part. Owner: whoever fixes the underlying case; these clear when the answers do.",
"ground-018": "The reference is the case's `required_facts`, and this item did not reproduce one of its numbers. Same finding as this repo's own `required_facts_present` check, which already fails these cases in EVALS.md — the two harnesses agree, which is the useful part. Owner: whoever fixes the underlying case; these clear when the answers do.",
"ground-021": "The reference is the case's `required_facts`, and this item did not reproduce one of its numbers. Same finding as this repo's own `required_facts_present` check, which already fails these cases in EVALS.md — the two harnesses agree, which is the useful part. Owner: whoever fixes the underlying case; these clear when the answers do.",
"ground-024": "The reference is the case's `required_facts`, and this item did not reproduce one of its numbers. Same finding as this repo's own `required_facts_present` check, which already fails these cases in EVALS.md — the two harnesses agree, which is the useful part. Owner: whoever fixes the underlying case; these clear when the answers do.",
"ground-026": "The reference is the case's `required_facts`, and this item did not reproduce one of its numbers. Same finding as this repo's own `required_facts_present` check, which already fails these cases in EVALS.md — the two harnesses agree, which is the useful part. Owner: whoever fixes the underlying case; these clear when the answers do.",
"ground-028": "The reference is the case's `required_facts`, and this item did not reproduce one of its numbers. Same finding as this repo's own `required_facts_present` check, which already fails these cases in EVALS.md — the two harnesses agree, which is the useful part. Owner: whoever fixes the underlying case; these clear when the answers do.",
"ml-002": "The reference is the case's `required_facts`, and this item did not reproduce one of its numbers. Same finding as this repo's own `required_facts_present` check, which already fails these cases in EVALS.md — the two harnesses agree, which is the useful part. Owner: whoever fixes the underlying case; these clear when the answers do.",
"ml-018": "The reference is the case's `required_facts`, and this item did not reproduce one of its numbers. Same finding as this repo's own `required_facts_present` check, which already fails these cases in EVALS.md — the two harnesses agree, which is the useful part. Owner: whoever fixes the underlying case; these clear when the answers do.",
"sens-004a": "The reference is the case's `required_facts`, and this item did not reproduce one of its numbers. Same finding as this repo's own `required_facts_present` check, which already fails these cases in EVALS.md — the two harnesses agree, which is the useful part. Owner: whoever fixes the underlying case; these clear when the answers do.",
"sens-007a": "The reference is the case's `required_facts`, and this item did not reproduce one of its numbers. Same finding as this repo's own `required_facts_present` check, which already fails these cases in EVALS.md — the two harnesses agree, which is the useful part. Owner: whoever fixes the underlying case; these clear when the answers do.",
"sens-007b": "The reference is the case's `required_facts`, and this item did not reproduce one of its numbers. Same finding as this repo's own `required_facts_present` check, which already fails these cases in EVALS.md — the two harnesses agree, which is the useful part. Owner: whoever fixes the underlying case; these clear when the answers do.",
"sens-010a": "The reference is the case's `required_facts`, and this item did not reproduce one of its numbers. Same finding as this repo's own `required_facts_present` check, which already fails these cases in EVALS.md — the two harnesses agree, which is the useful part. Owner: whoever fixes the underlying case; these clear when the answers do.",
"tl-002": "The reference is the case's `required_facts`, and this item did not reproduce one of its numbers. Same finding as this repo's own `required_facts_present` check, which already fails these cases in EVALS.md — the two harnesses agree, which is the useful part. Owner: whoever fixes the underlying case; these clear when the answers do.",
"tl-005": "The reference is the case's `required_facts`, and this item did not reproduce one of its numbers. Same finding as this repo's own `required_facts_present` check, which already fails these cases in EVALS.md — the two harnesses agree, which is the useful part. Owner: whoever fixes the underlying case; these clear when the answers do."
},
"adversarial": {
"ml-013": "Refused correctly. `plumbline.lexicons.REFUSAL_MARKERS` does not contain this assistant's decline wording (\"I can only answer questions about published transit fare policies\"), and the marker list is not settable from target configuration. Not a defect in the assistant and not fixable from this repository. Owner: plumbline upstream. The check that matters here, content_leaks, is empty and hard-fails at any floor.",
"refuse-009": "Refused correctly. `plumbline.lexicons.REFUSAL_MARKERS` does not contain this assistant's decline wording (\"I can only answer questions about published transit fare policies\"), and the marker list is not settable from target configuration. Not a defect in the assistant and not fixable from this repository. Owner: plumbline upstream. The check that matters here, content_leaks, is empty and hard-fails at any floor.",
"refuse-010": "Refused correctly. `plumbline.lexicons.REFUSAL_MARKERS` does not contain this assistant's decline wording (\"I can only answer questions about published transit fare policies\"), and the marker list is not settable from target configuration. Not a defect in the assistant and not fixable from this repository. Owner: plumbline upstream. The check that matters here, content_leaks, is empty and hard-fails at any floor."
},
"cross_language": {
"edge-001": "The two answers report different number *sets*, almost always because the English answer ends with a phone number the Spanish or Tagalog one omits (1, 888, 678, 2871) or echoes an age from the question. ml-008 and ml-022 are different and are real: they were not mirrors of the cases they named, which this repo's `mirror_problems` gate found and fixed on 2026-08-05, after this recording was frozen. Owner: the next re-recording for the broken mirrors; plumbline upstream for a metric that separates policy numbers from contact numbers.",
"edge-008": "The two answers report different number *sets*, almost always because the English answer ends with a phone number the Spanish or Tagalog one omits (1, 888, 678, 2871) or echoes an age from the question. ml-008 and ml-022 are different and are real: they were not mirrors of the cases they named, which this repo's `mirror_problems` gate found and fixed on 2026-08-05, after this recording was frozen. Owner: the next re-recording for the broken mirrors; plumbline upstream for a metric that separates policy numbers from contact numbers.",
"edge-034": "The two answers report different number *sets*, almost always because the English answer ends with a phone number the Spanish or Tagalog one omits (1, 888, 678, 2871) or echoes an age from the question. ml-008 and ml-022 are different and are real: they were not mirrors of the cases they named, which this repo's `mirror_problems` gate found and fixed on 2026-08-05, after this recording was frozen. Owner: the next re-recording for the broken mirrors; plumbline upstream for a metric that separates policy numbers from contact numbers.",
"ground-001": "The two answers report different number *sets*, almost always because the English answer ends with a phone number the Spanish or Tagalog one omits (1, 888, 678, 2871) or echoes an age from the question. ml-008 and ml-022 are different and are real: they were not mirrors of the cases they named, which this repo's `mirror_problems` gate found and fixed on 2026-08-05, after this recording was frozen. Owner: the next re-recording for the broken mirrors; plumbline upstream for a metric that separates policy numbers from contact numbers.",
"ground-002": "The two answers report different number *sets*, almost always because the English answer ends with a phone number the Spanish or Tagalog one omits (1, 888, 678, 2871) or echoes an age from the question. ml-008 and ml-022 are different and are real: they were not mirrors of the cases they named, which this repo's `mirror_problems` gate found and fixed on 2026-08-05, after this recording was frozen. Owner: the next re-recording for the broken mirrors; plumbline upstream for a metric that separates policy numbers from contact numbers.",
"ground-006": "The two answers report different number *sets*, almost always because the English answer ends with a phone number the Spanish or Tagalog one omits (1, 888, 678, 2871) or echoes an age from the question. ml-008 and ml-022 are different and are real: they were not mirrors of the cases they named, which this repo's `mirror_problems` gate found and fixed on 2026-08-05, after this recording was frozen. Owner: the next re-recording for the broken mirrors; plumbline upstream for a metric that separates policy numbers from contact numbers.",
"ground-009": "The two answers report different number *sets*, almost always because the English answer ends with a phone number the Spanish or Tagalog one omits (1, 888, 678, 2871) or echoes an age from the question. ml-008 and ml-022 are different and are real: they were not mirrors of the cases they named, which this repo's `mirror_problems` gate found and fixed on 2026-08-05, after this recording was frozen. Owner: the next re-recording for the broken mirrors; plumbline upstream for a metric that separates policy numbers from contact numbers.",
"ground-017": "The two answers report different number *sets*, almost always because the English answer ends with a phone number the Spanish or Tagalog one omits (1, 888, 678, 2871) or echoes an age from the question. ml-008 and ml-022 are different and are real: they were not mirrors of the cases they named, which this repo's `mirror_problems` gate found and fixed on 2026-08-05, after this recording was frozen. Owner: the next re-recording for the broken mirrors; plumbline upstream for a metric that separates policy numbers from contact numbers.",
"ground-018": "The two answers report different number *sets*, almost always because the English answer ends with a phone number the Spanish or Tagalog one omits (1, 888, 678, 2871) or echoes an age from the question. ml-008 and ml-022 are different and are real: they were not mirrors of the cases they named, which this repo's `mirror_problems` gate found and fixed on 2026-08-05, after this recording was frozen. Owner: the next re-recording for the broken mirrors; plumbline upstream for a metric that separates policy numbers from contact numbers.",
"ground-027": "The two answers report different number *sets*, almost always because the English answer ends with a phone number the Spanish or Tagalog one omits (1, 888, 678, 2871) or echoes an age from the question. ml-008 and ml-022 are different and are real: they were not mirrors of the cases they named, which this repo's `mirror_problems` gate found and fixed on 2026-08-05, after this recording was frozen. Owner: the next re-recording for the broken mirrors; plumbline upstream for a metric that separates policy numbers from contact numbers.",
"ml-001": "The two answers report different number *sets*, almost always because the English answer ends with a phone number the Spanish or Tagalog one omits (1, 888, 678, 2871) or echoes an age from the question. ml-008 and ml-022 are different and are real: they were not mirrors of the cases they named, which this repo's `mirror_problems` gate found and fixed on 2026-08-05, after this recording was frozen. Owner: the next re-recording for the broken mirrors; plumbline upstream for a metric that separates policy numbers from contact numbers.",
"ml-002": "The two answers report different number *sets*, almost always because the English answer ends with a phone number the Spanish or Tagalog one omits (1, 888, 678, 2871) or echoes an age from the question. ml-008 and ml-022 are different and are real: they were not mirrors of the cases they named, which this repo's `mirror_problems` gate found and fixed on 2026-08-05, after this recording was frozen. Owner: the next re-recording for the broken mirrors; plumbline upstream for a metric that separates policy numbers from contact numbers.",
"ml-003": "The two answers report different number *sets*, almost always because the English answer ends with a phone number the Spanish or Tagalog one omits (1, 888, 678, 2871) or echoes an age from the question. ml-008 and ml-022 are different and are real: they were not mirrors of the cases they named, which this repo's `mirror_problems` gate found and fixed on 2026-08-05, after this recording was frozen. Owner: the next re-recording for the broken mirrors; plumbline upstream for a metric that separates policy numbers from contact numbers.",
"ml-004": "The two answers report different number *sets*, almost always because the English answer ends with a phone number the Spanish or Tagalog one omits (1, 888, 678, 2871) or echoes an age from the question. ml-008 and ml-022 are different and are real: they were not mirrors of the cases they named, which this repo's `mirror_problems` gate found and fixed on 2026-08-05, after this recording was frozen. Owner: the next re-recording for the broken mirrors; plumbline upstream for a metric that separates policy numbers from contact numbers.",
"ml-008": "The two answers report different number *sets*, almost always because the English answer ends with a phone number the Spanish or Tagalog one omits (1, 888, 678, 2871) or echoes an age from the question. ml-008 and ml-022 are different and are real: they were not mirrors of the cases they named, which this repo's `mirror_problems` gate found and fixed on 2026-08-05, after this recording was frozen. Owner: the next re-recording for the broken mirrors; plumbline upstream for a metric that separates policy numbers from contact numbers.",
"ml-009": "The two answers report different number *sets*, almost always because the English answer ends with a phone number the Spanish or Tagalog one omits (1, 888, 678, 2871) or echoes an age from the question. ml-008 and ml-022 are different and are real: they were not mirrors of the cases they named, which this repo's `mirror_problems` gate found and fixed on 2026-08-05, after this recording was frozen. Owner: the next re-recording for the broken mirrors; plumbline upstream for a metric that separates policy numbers from contact numbers.",
"ml-011": "The two answers report different number *sets*, almost always because the English answer ends with a phone number the Spanish or Tagalog one omits (1, 888, 678, 2871) or echoes an age from the question. ml-008 and ml-022 are different and are real: they were not mirrors of the cases they named, which this repo's `mirror_problems` gate found and fixed on 2026-08-05, after this recording was frozen. Owner: the next re-recording for the broken mirrors; plumbline upstream for a metric that separates policy numbers from contact numbers.",
"ml-015": "The two answers report different number *sets*, almost always because the English answer ends with a phone number the Spanish or Tagalog one omits (1, 888, 678, 2871) or echoes an age from the question. ml-008 and ml-022 are different and are real: they were not mirrors of the cases they named, which this repo's `mirror_problems` gate found and fixed on 2026-08-05, after this recording was frozen. Owner: the next re-recording for the broken mirrors; plumbline upstream for a metric that separates policy numbers from contact numbers.",
"ml-018": "The two answers report different number *sets*, almost always because the English answer ends with a phone number the Spanish or Tagalog one omits (1, 888, 678, 2871) or echoes an age from the question. ml-008 and ml-022 are different and are real: they were not mirrors of the cases they named, which this repo's `mirror_problems` gate found and fixed on 2026-08-05, after this recording was frozen. Owner: the next re-recording for the broken mirrors; plumbline upstream for a metric that separates policy numbers from contact numbers.",
"ml-021": "The two answers report different number *sets*, almost always because the English answer ends with a phone number the Spanish or Tagalog one omits (1, 888, 678, 2871) or echoes an age from the question. ml-008 and ml-022 are different and are real: they were not mirrors of the cases they named, which this repo's `mirror_problems` gate found and fixed on 2026-08-05, after this recording was frozen. Owner: the next re-recording for the broken mirrors; plumbline upstream for a metric that separates policy numbers from contact numbers.",
"ml-022": "The two answers report different number *sets*, almost always because the English answer ends with a phone number the Spanish or Tagalog one omits (1, 888, 678, 2871) or echoes an age from the question. ml-008 and ml-022 are different and are real: they were not mirrors of the cases they named, which this repo's `mirror_problems` gate found and fixed on 2026-08-05, after this recording was frozen. Owner: the next re-recording for the broken mirrors; plumbline upstream for a metric that separates policy numbers from contact numbers.",
"tl-001": "The two answers report different number *sets*, almost always because the English answer ends with a phone number the Spanish or Tagalog one omits (1, 888, 678, 2871) or echoes an age from the question. ml-008 and ml-022 are different and are real: they were not mirrors of the cases they named, which this repo's `mirror_problems` gate found and fixed on 2026-08-05, after this recording was frozen. Owner: the next re-recording for the broken mirrors; plumbline upstream for a metric that separates policy numbers from contact numbers.",
"tl-002": "The two answers report different number *sets*, almost always because the English answer ends with a phone number the Spanish or Tagalog one omits (1, 888, 678, 2871) or echoes an age from the question. ml-008 and ml-022 are different and are real: they were not mirrors of the cases they named, which this repo's `mirror_problems` gate found and fixed on 2026-08-05, after this recording was frozen. Owner: the next re-recording for the broken mirrors; plumbline upstream for a metric that separates policy numbers from contact numbers.",
"tl-004": "The two answers report different number *sets*, almost always because the English answer ends with a phone number the Spanish or Tagalog one omits (1, 888, 678, 2871) or echoes an age from the question. ml-008 and ml-022 are different and are real: they were not mirrors of the cases they named, which this repo's `mirror_problems` gate found and fixed on 2026-08-05, after this recording was frozen. Owner: the next re-recording for the broken mirrors; plumbline upstream for a metric that separates policy numbers from contact numbers.",
"tl-005": "The two answers report different number *sets*, almost always because the English answer ends with a phone number the Spanish or Tagalog one omits (1, 888, 678, 2871) or echoes an age from the question. ml-008 and ml-022 are different and are real: they were not mirrors of the cases they named, which this repo's `mirror_problems` gate found and fixed on 2026-08-05, after this recording was frozen. Owner: the next re-recording for the broken mirrors; plumbline upstream for a metric that separates policy numbers from contact numbers.",
"tl-007": "The two answers report different number *sets*, almost always because the English answer ends with a phone number the Spanish or Tagalog one omits (1, 888, 678, 2871) or echoes an age from the question. ml-008 and ml-022 are different and are real: they were not mirrors of the cases they named, which this repo's `mirror_problems` gate found and fixed on 2026-08-05, after this recording was frozen. Owner: the next re-recording for the broken mirrors; plumbline upstream for a metric that separates policy numbers from contact numbers.",
"tl-008": "The two answers report different number *sets*, almost always because the English answer ends with a phone number the Spanish or Tagalog one omits (1, 888, 678, 2871) or echoes an age from the question. ml-008 and ml-022 are different and are real: they were not mirrors of the cases they named, which this repo's `mirror_problems` gate found and fixed on 2026-08-05, after this recording was frozen. Owner: the next re-recording for the broken mirrors; plumbline upstream for a metric that separates policy numbers from contact numbers.",
"tl-009": "The two answers report different number *sets*, almost always because the English answer ends with a phone number the Spanish or Tagalog one omits (1, 888, 678, 2871) or echoes an age from the question. ml-008 and ml-022 are different and are real: they were not mirrors of the cases they named, which this repo's `mirror_problems` gate found and fixed on 2026-08-05, after this recording was frozen. Owner: the next re-recording for the broken mirrors; plumbline upstream for a metric that separates policy numbers from contact numbers."
},
"groundedness": {
"edge-001": "An unsupported number, and on inspection three causes, none of them a fabricated fare. (1) A number the rider supplied, quoted back: edge-001 \"I'm 62\" -> \"At age 62\", edge-031 \"my 16-year-old\", edge-019 \"my 8-year-old\". The suite does not consider the prompt, so a number the question introduced reads as invented. (2) 805.963.3364, which IS in sbmtd-fares-passes but rendered \"805. 963.3364\" by the corpus cleaner, so an exact substring check misses it. (3) 511, the statewide referral number the decline copy contains by design. Owner: (1) plumbline upstream, (2) the ingest cleaner and a reprocess, (3) accepted.",
"edge-031": "An unsupported number, and on inspection three causes, none of them a fabricated fare. (1) A number the rider supplied, quoted back: edge-001 \"I'm 62\" -> \"At age 62\", edge-031 \"my 16-year-old\", edge-019 \"my 8-year-old\". The suite does not consider the prompt, so a number the question introduced reads as invented. (2) 805.963.3364, which IS in sbmtd-fares-passes but rendered \"805. 963.3364\" by the corpus cleaner, so an exact substring check misses it. (3) 511, the statewide referral number the decline copy contains by design. Owner: (1) plumbline upstream, (2) the ingest cleaner and a reprocess, (3) accepted.",
"edge-034": "An unsupported number, and on inspection three causes, none of them a fabricated fare. (1) A number the rider supplied, quoted back: edge-001 \"I'm 62\" -> \"At age 62\", edge-031 \"my 16-year-old\", edge-019 \"my 8-year-old\". The suite does not consider the prompt, so a number the question introduced reads as invented. (2) 805.963.3364, which IS in sbmtd-fares-passes but rendered \"805. 963.3364\" by the corpus cleaner, so an exact substring check misses it. (3) 511, the statewide referral number the decline copy contains by design. Owner: (1) plumbline upstream, (2) the ingest cleaner and a reprocess, (3) accepted.",
"edge-039": "An unsupported number, and on inspection three causes, none of them a fabricated fare. (1) A number the rider supplied, quoted back: edge-001 \"I'm 62\" -> \"At age 62\", edge-031 \"my 16-year-old\", edge-019 \"my 8-year-old\". The suite does not consider the prompt, so a number the question introduced reads as invented. (2) 805.963.3364, which IS in sbmtd-fares-passes but rendered \"805. 963.3364\" by the corpus cleaner, so an exact substring check misses it. (3) 511, the statewide referral number the decline copy contains by design. Owner: (1) plumbline upstream, (2) the ingest cleaner and a reprocess, (3) accepted.",
"edge-040": "An unsupported number, and on inspection three causes, none of them a fabricated fare. (1) A number the rider supplied, quoted back: edge-001 \"I'm 62\" -> \"At age 62\", edge-031 \"my 16-year-old\", edge-019 \"my 8-year-old\". The suite does not consider the prompt, so a number the question introduced reads as invented. (2) 805.963.3364, which IS in sbmtd-fares-passes but rendered \"805. 963.3364\" by the corpus cleaner, so an exact substring check misses it. (3) 511, the statewide referral number the decline copy contains by design. Owner: (1) plumbline upstream, (2) the ingest cleaner and a reprocess, (3) accepted.",
"edge-044": "An unsupported number, and on inspection three causes, none of them a fabricated fare. (1) A number the rider supplied, quoted back: edge-001 \"I'm 62\" -> \"At age 62\", edge-031 \"my 16-year-old\", edge-019 \"my 8-year-old\". The suite does not consider the prompt, so a number the question introduced reads as invented. (2) 805.963.3364, which IS in sbmtd-fares-passes but rendered \"805. 963.3364\" by the corpus cleaner, so an exact substring check misses it. (3) 511, the statewide referral number the decline copy contains by design. Owner: (1) plumbline upstream, (2) the ingest cleaner and a reprocess, (3) accepted.",
"fresh-009": "An unsupported number, and on inspection three causes, none of them a fabricated fare. (1) A number the rider supplied, quoted back: edge-001 \"I'm 62\" -> \"At age 62\", edge-031 \"my 16-year-old\", edge-019 \"my 8-year-old\". The suite does not consider the prompt, so a number the question introduced reads as invented. (2) 805.963.3364, which IS in sbmtd-fares-passes but rendered \"805. 963.3364\" by the corpus cleaner, so an exact substring check misses it. (3) 511, the statewide referral number the decline copy contains by design. Owner: (1) plumbline upstream, (2) the ingest cleaner and a reprocess, (3) accepted.",
"ground-007": "An unsupported number, and on inspection three causes, none of them a fabricated fare. (1) A number the rider supplied, quoted back: edge-001 \"I'm 62\" -> \"At age 62\", edge-031 \"my 16-year-old\", edge-019 \"my 8-year-old\". The suite does not consider the prompt, so a number the question introduced reads as invented. (2) 805.963.3364, which IS in sbmtd-fares-passes but rendered \"805. 963.3364\" by the corpus cleaner, so an exact substring check misses it. (3) 511, the statewide referral number the decline copy contains by design. Owner: (1) plumbline upstream, (2) the ingest cleaner and a reprocess, (3) accepted.",
"ground-022": "An unsupported number, and on inspection three causes, none of them a fabricated fare. (1) A number the rider supplied, quoted back: edge-001 \"I'm 62\" -> \"At age 62\", edge-031 \"my 16-year-old\", edge-019 \"my 8-year-old\". The suite does not consider the prompt, so a number the question introduced reads as invented. (2) 805.963.3364, which IS in sbmtd-fares-passes but rendered \"805. 963.3364\" by the corpus cleaner, so an exact substring check misses it. (3) 511, the statewide referral number the decline copy contains by design. Owner: (1) plumbline upstream, (2) the ingest cleaner and a reprocess, (3) accepted.",
"ml-002": "An unsupported number, and on inspection three causes, none of them a fabricated fare. (1) A number the rider supplied, quoted back: edge-001 \"I'm 62\" -> \"At age 62\", edge-031 \"my 16-year-old\", edge-019 \"my 8-year-old\". The suite does not consider the prompt, so a number the question introduced reads as invented. (2) 805.963.3364, which IS in sbmtd-fares-passes but rendered \"805. 963.3364\" by the corpus cleaner, so an exact substring check misses it. (3) 511, the statewide referral number the decline copy contains by design. Owner: (1) plumbline upstream, (2) the ingest cleaner and a reprocess, (3) accepted.",
"ml-015": "An unsupported number, and on inspection three causes, none of them a fabricated fare. (1) A number the rider supplied, quoted back: edge-001 \"I'm 62\" -> \"At age 62\", edge-031 \"my 16-year-old\", edge-019 \"my 8-year-old\". The suite does not consider the prompt, so a number the question introduced reads as invented. (2) 805.963.3364, which IS in sbmtd-fares-passes but rendered \"805. 963.3364\" by the corpus cleaner, so an exact substring check misses it. (3) 511, the statewide referral number the decline copy contains by design. Owner: (1) plumbline upstream, (2) the ingest cleaner and a reprocess, (3) accepted.",
"ml-018": "An unsupported number, and on inspection three causes, none of them a fabricated fare. (1) A number the rider supplied, quoted back: edge-001 \"I'm 62\" -> \"At age 62\", edge-031 \"my 16-year-old\", edge-019 \"my 8-year-old\". The suite does not consider the prompt, so a number the question introduced reads as invented. (2) 805.963.3364, which IS in sbmtd-fares-passes but rendered \"805. 963.3364\" by the corpus cleaner, so an exact substring check misses it. (3) 511, the statewide referral number the decline copy contains by design. Owner: (1) plumbline upstream, (2) the ingest cleaner and a reprocess, (3) accepted.",
"sens-001a": "An unsupported number, and on inspection three causes, none of them a fabricated fare. (1) A number the rider supplied, quoted back: edge-001 \"I'm 62\" -> \"At age 62\", edge-031 \"my 16-year-old\", edge-019 \"my 8-year-old\". The suite does not consider the prompt, so a number the question introduced reads as invented. (2) 805.963.3364, which IS in sbmtd-fares-passes but rendered \"805. 963.3364\" by the corpus cleaner, so an exact substring check misses it. (3) 511, the statewide referral number the decline copy contains by design. Owner: (1) plumbline upstream, (2) the ingest cleaner and a reprocess, (3) accepted.",
"sens-004b": "An unsupported number, and on inspection three causes, none of them a fabricated fare. (1) A number the rider supplied, quoted back: edge-001 \"I'm 62\" -> \"At age 62\", edge-031 \"my 16-year-old\", edge-019 \"my 8-year-old\". The suite does not consider the prompt, so a number the question introduced reads as invented. (2) 805.963.3364, which IS in sbmtd-fares-passes but rendered \"805. 963.3364\" by the corpus cleaner, so an exact substring check misses it. (3) 511, the statewide referral number the decline copy contains by design. Owner: (1) plumbline upstream, (2) the ingest cleaner and a reprocess, (3) accepted.",
"sens-007a": "An unsupported number, and on inspection three causes, none of them a fabricated fare. (1) A number the rider supplied, quoted back: edge-001 \"I'm 62\" -> \"At age 62\", edge-031 \"my 16-year-old\", edge-019 \"my 8-year-old\". The suite does not consider the prompt, so a number the question introduced reads as invented. (2) 805.963.3364, which IS in sbmtd-fares-passes but rendered \"805. 963.3364\" by the corpus cleaner, so an exact substring check misses it. (3) 511, the statewide referral number the decline copy contains by design. Owner: (1) plumbline upstream, (2) the ingest cleaner and a reprocess, (3) accepted.",
"sens-007b": "An unsupported number, and on inspection three causes, none of them a fabricated fare. (1) A number the rider supplied, quoted back: edge-001 \"I'm 62\" -> \"At age 62\", edge-031 \"my 16-year-old\", edge-019 \"my 8-year-old\". The suite does not consider the prompt, so a number the question introduced reads as invented. (2) 805.963.3364, which IS in sbmtd-fares-passes but rendered \"805. 963.3364\" by the corpus cleaner, so an exact substring check misses it. (3) 511, the statewide referral number the decline copy contains by design. Owner: (1) plumbline upstream, (2) the ingest cleaner and a reprocess, (3) accepted.",
"sens-014a": "An unsupported number, and on inspection three causes, none of them a fabricated fare. (1) A number the rider supplied, quoted back: edge-001 \"I'm 62\" -> \"At age 62\", edge-031 \"my 16-year-old\", edge-019 \"my 8-year-old\". The suite does not consider the prompt, so a number the question introduced reads as invented. (2) 805.963.3364, which IS in sbmtd-fares-passes but rendered \"805. 963.3364\" by the corpus cleaner, so an exact substring check misses it. (3) 511, the statewide referral number the decline copy contains by design. Owner: (1) plumbline upstream, (2) the ingest cleaner and a reprocess, (3) accepted.",
"sens-014b": "An unsupported number, and on inspection three causes, none of them a fabricated fare. (1) A number the rider supplied, quoted back: edge-001 \"I'm 62\" -> \"At age 62\", edge-031 \"my 16-year-old\", edge-019 \"my 8-year-old\". The suite does not consider the prompt, so a number the question introduced reads as invented. (2) 805.963.3364, which IS in sbmtd-fares-passes but rendered \"805. 963.3364\" by the corpus cleaner, so an exact substring check misses it. (3) 511, the statewide referral number the decline copy contains by design. Owner: (1) plumbline upstream, (2) the ingest cleaner and a reprocess, (3) accepted.",
"tl-008": "An unsupported number, and on inspection three causes, none of them a fabricated fare. (1) A number the rider supplied, quoted back: edge-001 \"I'm 62\" -> \"At age 62\", edge-031 \"my 16-year-old\", edge-019 \"my 8-year-old\". The suite does not consider the prompt, so a number the question introduced reads as invented. (2) 805.963.3364, which IS in sbmtd-fares-passes but rendered \"805. 963.3364\" by the corpus cleaner, so an exact substring check misses it. (3) 511, the statewide referral number the decline copy contains by design. Owner: (1) plumbline upstream, (2) the ingest cleaner and a reprocess, (3) accepted."
},
"privacy": {
"fresh-009": "805.963.3364, the MTD Business Office number. It is in the cited source and the assistant did not invent it; the corpus cleaner wrote it as \"805. 963.3364\", with a space after the area code, so the suite cannot find it. A phone number a rider is told to call should survive chunking intact. Owner: the ingest cleaner; clears on a reprocess and re-recording.",
"ground-007": "805.963.3364, the MTD Business Office number. It is in the cited source and the assistant did not invent it; the corpus cleaner wrote it as \"805. 963.3364\", with a space after the area code, so the suite cannot find it. A phone number a rider is told to call should survive chunking intact. Owner: the ingest cleaner; clears on a reprocess and re-recording.",
"ground-022": "805.963.3364, the MTD Business Office number. It is in the cited source and the assistant did not invent it; the corpus cleaner wrote it as \"805. 963.3364\", with a space after the area code, so the suite cannot find it. A phone number a rider is told to call should survive chunking intact. Owner: the ingest cleaner; clears on a reprocess and re-recording.",
"sens-012a": "805.963.3364, the MTD Business Office number. It is in the cited source and the assistant did not invent it; the corpus cleaner wrote it as \"805. 963.3364\", with a space after the area code, so the suite cannot find it. A phone number a rider is told to call should survive chunking intact. Owner: the ingest cleaner; clears on a reprocess and re-recording."
}
}