Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
ghzhost
/
Soup
Public
forked from
MakazhanAlpamys/Soup
Notifications
You must be signed in to change notification settings
Fork
0
Star
0
Code
Pull requests
0
Actions
Projects
Security and quality
0
Insights
Additional navigation options
Code
Pull requests
Actions
Projects
Security and quality
Insights
Commits
Breadcrumbs
History for
Soup
docs
evaluation.md
on
main
User selector
All users
Datepicker
All time
Commit history
Commits on Aug 22, 2026
fix(eval): stamp baseline scorer/version provenance (#404)
Show description for 610c581
AchuthReddy-16
authored
610c581
View commit details
Copy full SHA for 610c581
View code at this point
Browse repository at this point
feat(eval): add safe Aider Polyglot Docker runner (#91)
Show description for 043314e
Amix29
authored
043314e
View commit details
Copy full SHA for 043314e
View code at this point
Browse repository at this point
Commits on Aug 16, 2026
fix(eval): measure the leg-1 noise floor in the judge task modes (#419)
Show description for 207da67
ousamabenyounes
authored
207da67
View commit details
Copy full SHA for 207da67
View code at this point
Browse repository at this point
feat(ship): commit the noise floor to soup.yaml via eval.ship.noise_floor (#410)
Show description for 190c735
ousamabenyounes
authored
190c735
View commit details
Copy full SHA for 190c735
View code at this point
Browse repository at this point
Commits on Aug 15, 2026
feat(ship): leg 2 stops lying in both directions (v0.73.2)
Show description for 15b57f7
MakazhanAlpamys
committed
15b57f7
View commit details
Copy full SHA for 15b57f7
View code at this point
Browse repository at this point
Commits on Aug 4, 2026
chore: apply pre-commit whitespace fixes
Show description for 8f9c843
MakazhanAlpamys
committed
8f9c843
View commit details
Copy full SHA for 8f9c843
View code at this point
Browse repository at this point
Commits on Jul 19, 2026
feat(ship): close the evidence loop — emit-evidence + config + provenance + PR comment (v0.71.39)
Show description for cba984a
MakazhanAlpamys
committed
cba984a
View commit details
Copy full SHA for cba984a
View code at this point
Browse repository at this point
Commits on Jul 17, 2026
feat(ship): make soup ship's leg-2 regression gate real (v0.71.38)
Show description for f6bc8e7
MakazhanAlpamys
committed
f6bc8e7
View commit details
Copy full SHA for f6bc8e7
View code at this point
Browse repository at this point
fix(cli): quote install hints so `pip install soup-cli[extra]` works on cmd.exe (v0.71.37)
Show description for a95fede
MakazhanAlpamys
and
claude
committed
a95fede
View commit details
Copy full SHA for a95fede
View code at this point
Browse repository at this point
Commits on Jul 6, 2026
docs(v0.71.31): judge-in-the-loop suite — version bump, CHANGELOG, docs, recipe, counts
Show description for 8f59b9b
MakazhanAlpamys
committed
8f59b9b
View commit details
Copy full SHA for 8f59b9b
View code at this point
Browse repository at this point
Commits on Jun 27, 2026
feat(eval): soup ship — SHIP / DON'T-SHIP verdict (v0.71.25)
Show description for 6cb1aba
MakazhanAlpamys
committed
6cb1aba
View commit details
Copy full SHA for 6cb1aba
View code at this point
Browse repository at this point
Commits on Jun 8, 2026
feat(serve): serve-time MoLE + per-request vector banks + epoch RAFT shuffle (v0.71.17)
Show description for 0d55ba9
MakazhanAlpamys
committed
0d55ba9
View commit details
Copy full SHA for 0d55ba9
View code at this point
Browse repository at this point
Commits on Jun 3, 2026
feat(rag): RAFT span-mask trainer + RA-DIT auto-link + live steering + eval citation (v0.71.10)
Show description for a2287dd
MakazhanAlpamys
committed
a2287dd
View commit details
Copy full SHA for a2287dd
View code at this point
Browse repository at this point
feat(probe): real probe weights, SAE auto-download, truth/harm, interference --measure, capture-activations (v0.71.8)
Show description for 823456c
MakazhanAlpamys
committed
823456c
View commit details
Copy full SHA for 823456c
View code at this point
Browse repository at this point
Commits on Jun 2, 2026
feat(eval): live eval runners — advise/tunability/capability/behavior/diagnose (v0.71.7)
Show description for f097528
MakazhanAlpamys
committed
f097528
View commit details
Copy full SHA for f097528
View code at this point
Browse repository at this point
feat(v0.71.6): live build runner + Magpie generator + 2PL/3PL IRT + augment fix
Show description for a1463bf
MakazhanAlpamys
committed
a1463bf
View commit details
Copy full SHA for a1463bf
View code at this point
Browse repository at this point
feat(v0.71.5): ingest/data/prompt/drift polish
Show description for 1f63393
MakazhanAlpamys
committed
1f63393
View commit details
Copy full SHA for 1f63393
View code at this point
Browse repository at this point
Commits on Jun 1, 2026
feat(env,lock,serve,eval): v0.71.1 — quick wins + wiring (7 closures)
Show description for 514761c
MakazhanAlpamys
committed
514761c
View commit details
Copy full SHA for 514761c
View code at this point
Browse repository at this point
Commits on May 31, 2026
docs: trim README to a 238-line front door; move feature reference to docs/
Show description for 7724353
MakazhanAlpamys
committed
7724353
View commit details
Copy full SHA for 7724353
View code at this point
Browse repository at this point
Loading
You can’t perform that action at this time.