Everything Green, Everything Broken
LLMs in Production, the Failures That Raise No Error and the Five Numbers Nobody Counts
Failed to add items
Sorry, we are unable to add the item because your shopping cart is already at capacity.
Add to basket failed.
Please try again later
Add to wishlist failed.
Please try again later
Remove from wishlist failed.
Please try again later
Adding to library failed
Please try again
Follow podcast failed
Unfollow podcast failed
Get 30 days of Standard free
£5.99/mo after trial. Cancel monthly.
Buy Now for £9.69
-
Narrated by:
-
AI Voice A synthetic voice
-
By:
-
Nikolaos Broikos
This title uses virtual voice narration
Virtual voice is computer-generated narration for audiobooks.
A model refused to answer while the answer sat in front of it, complete and correct, and then invented a data quality problem to justify the refusal, in the register of a careful bug report. A filter identified sensitive material perfectly, labelled it, wrote a log line proving it had seen it, and let it through. An upgrade rewrote the format of more than a quarter of responses while every accuracy test reported a clean migration. A cost model was wrong in two directions at once.
Six failures. Zero errors. Several of them producing positive evidence of health.
None of it was hidden. All of it sat in plain text, in fields nobody aggregated, phrased in a way nothing matched, or summarised by a statistic that absorbs exactly that signal. This book is about the class of failure that leaves no trace your monitoring was built to catch, and the five cheap numbers that catch it instead. None of them needs a labelled dataset, a vendor, a budget or anybody's permission.
The good news is the argument. The unpredictable part of your system was always the small part. The provable part was always most of it, and almost nobody tests it, because the presence of a model made an entire subsystem feel unmeasurable when it is not.
For engineers and technical leaders running something real, who suspect the green dashboard is not the whole story and want to know exactly where to look.
adbl_web_anon_alc_button_suppression_t1
No reviews yet