Why the rise of AI-assisted development makes precise specifications more important, not less. There is a conversation happening in software and testing teams right now that goes roughly like this: “We have Claude now. We can just describe what we want in plain English and get code back. Do we still need all the formal…
Tag Archives: llm
Ukategorisert
Benchmarking LLMs on complex data structures: Who really understands Tomato model-based testing?
Recently, we put four very different LLMs through a grueling testing gauntlet to see if they can move beyond simple chat and handle complex, structured data modeling. The benchmark tested their ability to generate logic nodes, handle deep structural nesting and flattening in YAML, inject localized mock data, and parse multi-modal inputs (Images and PDFs)…