forked from ChelseaKR/plumbline
-
Notifications
You must be signed in to change notification settings - Fork 0
Expand file tree
/
Copy pathCITATION.cff
More file actions
28 lines (28 loc) · 1.12 KB
/
Copy pathCITATION.cff
File metadata and controls
28 lines (28 loc) · 1.12 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
cff-version: 1.2.0
message: "If you use Plumbline, please cite it as below."
title: "Plumbline: a fail-closed evaluation harness for government-facing chat systems"
abstract: >-
A deterministic, offline-by-default evaluation harness that grades a
government-facing chat system against an executable quality bar and produces
a sealed, provenance-stamped audit report. Fifteen scoring suites, per-suite
confidence intervals and minimum detectable effect, baseline regression
comparison, and a pinned fail-closed CI gate. Tampered evidence refuses to
score rather than scoring around the tampering; a target that returns nothing
is never credited with a pass; identical inputs and seed produce
byte-identical reports. The bundled dataset is synthetic and demonstrates the
instrument; it measures no real system.
type: software
authors:
- given-names: Chelsea
family-names: Kelly-Reif
license: Apache-2.0
version: "0.2.0"
date-released: "2026-08-22"
repository-code: "https://github.com/ChelseaKR/plumbline"
url: "https://github.com/ChelseaKR/plumbline"
keywords:
- evaluation
- audit
- llm
- civic-tech
- ci-gate