Tag Archives: llm

AI Builds. You Focus on Testing.

By Kjell Omdal Erichsen, Testify I’ve been using AI tools in my daily work for about twenty months now. Not to replace testing, but to do more of it, faster, in situations where the alternative was simply not testing at all. Here are three short stories to illustrate what that actually looks like. #1 The…

LLMs Are Just Another Compiler. And That’s a Good Thing!

Why the rise of AI-assisted development makes precise specifications more important, not less. There is a conversation happening in software and testing teams right now that goes roughly like this: “We have Claude now. We can just describe what we want in plain English and get code back. Do we still need all the formal…

Benchmarking LLMs on complex data structures: Who really understands Tomato model-based testing?

Recently, we put four very different LLMs through a grueling testing gauntlet to see if they can move beyond simple chat and handle complex, structured data modeling. The benchmark tested their ability to generate logic nodes, handle deep structural nesting and flattening in YAML, inject localized mock data, and parse multi-modal inputs (Images and PDFs)…