Every architecture diagram I see draws the same three boxes. Sometimes it’s Model + RAG + MCP . Sometimes it’s Model + MCP + Tools. The labels move around, but the shape never changes. The…
Executive summary AI evals test what an answer says and how it says it. They rarely test whether the number inside it is right, and that number is what the business acts on. A wrong…
Ask your AI what churn was last quarter, and it will give you a number. It won’t tell you whether that’s logo churn or revenue churn, or whether it includes voluntary cancellations. A human analyst…
Executive Summary: An agent doesn’t have a gut check, so it treats a wrong answer as fact and can’t catch it before building the next question on top of it, and accuracy drags down fast…
When Snowflake launched the Open Semantic Interchange in September 2025, dozens of companies signed on. Microsoft wasn’t one of them. Power BI’s semantic models stayed in DAX, built for Power BI, while the rest of…
Executive summary AI leaderboard rankings measure a model working alone, on tasks that look little like your warehouse. On the 410 business questions in the BIRD-Interact benchmark, what sat under the model made a bigger…
What is BIRD-Interact? BIRD-Interact is an independent benchmark that tests how well AI systems complete database tasks through conversation. It evaluates whether a system can clarify a vague request, explore the database schema, write correct…
Executive summary AI tools, like AtScale’s CoModel, can now draft most of a semantic model, and that will change the data modeler’s job. Claude Sonnet 5, working through a semantic layer that AI generated and…
Executive summary Your team makes most AI accuracy fixes for one model. When that model changes, custom training has to be rerun on the new model, and prompts and skills files have to be retested.…
Executive summary Self-service BI stalled at about 25% of employees for more than a decade because the numbers didn’t agree, not because the tools were hard to use. AI chat makes asking easy again, but…