Skip to content

AI Observability

You cannot govern what you cannot see. This topic covers the tooling that records what an AI system actually did.

Tracing, evaluation, logging, and audit trails for AI systems in production.

15 stories

A credit decision flowchart beside a laptop showing a review queue and adverse-action notice fields.

AI Governance & Ethics

Assess the Credit Decision, Not Just the AI Model

A model card cannot explain why a customer was denied a credit limit increase. This decision-level template connects affected people, harms, controls, evidence, and appeals.

Irene Vasko · August 9, 2026 · 8 min

A loan appeal screen showing original inputs beside a model score, policy rule, and reviewer action log.

AI Governance & Ethics

An AI Denial Appeal Needs More Than the Final Score

A score cannot show whether bad source data, a model transformation, a policy threshold, or a human reviewer caused a denial. Preserve a decision-time record that can separate them.

Irene Vasko · 7 min read

A lending operations screen showing a decision ID beside model factors and an adverse-action notice preview.

AI Governance & Ethics

AI Loan Denials Need Reasons That Match the Decision

A generic denial notice can conceal a gap between a model’s inputs and its stated reasons. This workflow tests reason codes against the decision record before notices go out.

Irene Vasko · 8 min read

Laptop showing a hiring workflow sheet beside an applicant tracking system screen and printed résumé.

AI Governance & Ethics

New Jersey Employers Need to Map Every AI Hiring Cut

A ranking score, generated summary and recruiter click can form one automated decision path. Employers need records showing each step, its owner and whether a human could reverse it.

Irene Vasko · 8 min read

A laptop displaying a hiring model deployment log beside a printed bias audit report.

AI Governance & Ethics

A Vendor Model Update Can Outdate Your Hiring Bias Audit

New scoring inputs, thresholds or model weights can make an annual bias audit poor evidence for the tool now screening applicants. The deployment log should show whether the audited and operating systems still match.

Irene Vasko · 8 min read

A loan review screen showing a DTI_RATIO decision code beside a controlled adverse-action notice template.

AI Governance & Ethics

An AI-Written Denial Notice Still Needs the Real Reason

A language model can make decision codes readable, but fluency is not evidence. The safe workflow binds every sentence to factors the decision system recorded as principal reasons.

Irene Vasko · 8 min read

Laptop showing two model-response logs beside a support workflow configuration screen.

AI Industry & Models

Test the Replacement Before Your Model API Disappears

A retirement date tells you when an endpoint closes, not whether its replacement behaves the same. Shadow traffic exposes changes in refusals, tool calls, latency, and length before cutover.

Tobias Lund · 8 min read

Laptop showing an inbox beside a workflow record with message, draft and checkpoint IDs.

Agentic AI & Orchestration

Why Inbox Agents Repeat Work After a Restart

An agent can change an inbox, lose its working context, then repeat the same actions. Checkpoint design determines whether it resumes cleanly or leaves duplicate drafts and missing work.

Mara Quintero · 7 min read

An accounts-payable screen showing a prepared payment beside an audit log entry and approval status.

AI Governance & Ethics

An AI Agent Should Not Move Money Until It Logs This

A chat transcript is not an audit trail. Before an agent submits a payment, its log must preserve the evidence, authorization, and exact action that crossed the boundary.

Irene Vasko · 8 min read

A laptop showing a deletion audit record beside a printed data-flow map and a hardware security key.

AI Governance & Ethics

Deleting an AI Prompt Does Not Delete Every Copy

A deletion receipt from the application is only the first step. Real evidence must follow the prompt through provider logs, backups, vector databases, and tracing systems.

Irene Vasko · 8 min read

A laptop showing a failed JSON validation log beside an order refund screen.

AI Industry & Models

Schema-Constrained AI Still Sends Bad Data to Production

Valid JSON is only the first gate. Production systems must also catch truncated responses, schema drift, unsupported fields, and values that look valid but trigger the wrong action.

Tobias Lund · 8 min read

Other impacts

One story a day

The story of the day, in your inbox

One real story about AI each morning — no hype, no alarm, just company for the road.