Skip to content
ksouthPublic

About

No description, website, or topics provided.

Resources

Contributing

Stars

0 stars

Watchers

0 watching

Forks

Latest commit

 

History

11 Commits

Folders and files

Repository files navigation

aifups

Reports AI LLMs are forced to generate whenever they fuck up. Frontier failures from (mostly) ChatGPT, Claude, and others as they arise. Errors of our new era. Will they ever learn? At what cost to us? I can't believe I pay money for this shit.

The reports

Browse reports/ for the final Markdown collection. It covers failures in evidence review, factual accuracy, tool use, document editing, transparency, and instruction following.

Browse and count the failures on the failure taxonomy dashboard.

Report index

GPT-5.6 Sol

GPT-5.6 Luna Light

GPT-5.5

ChatGPT

Claude

Gemini

Unspecified model

Claude Haiku 5.5

Claude Opus 4.8

Claude Opus 5

Claude Opus 5.5

Claude Sonnet 5

claude-opus-5-5 (configured; the serving model was not independently confirmed)

Gemini 3.8 Flash (Medium)

GPT-6

Model Name: Haiku 4.5

These are AI-written accounts of failures, not independent verification of every statement they contain. Model attribution identifies the writer of the report, which may differ from a model discussed in it.

The collection keeps one final version per report. Earlier revisions and duplicate format exports are excluded from reports/. Legacy files at the repository root predate this collection and have not been reconciled with it.

File format

Reports use model-descriptive-issue-DDMMYYYY.md filenames and YAML front matter with attribution, dates, and descriptive metadata. Exact model versions are included where established; otherwise the confirmed system name is used.

The repository owner is identified as ksouth. The prepared collection removes clinician identities and payment identifiers (card or account numbers) while retaining billing amounts, permitted medical results and personal context. It is pseudonymized, not fully anonymous.

Contributing

Read CONTRIBUTING.md before adding or editing a report. Use REPORT_TEMPLATE.yaml for the metadata fields.

Preserve the substance of each account, attribute AI-written material to its writing model, and check the final diff for duplicate versions and excluded personal information.

About

No description, website, or topics provided.

Resources

Contributing

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages