https://dennis-whalen-dot-com.vercel.app/tags/ai/Recent content in AI on Dennis-Whalen Dot ComHugo -- gohugo.ioen-usDennis WhalenSun, 31 Aug 2025 00:00:00 +0000https://dennis-whalen-dot-com.vercel.app/blog/ai/promptfoo/promptfoo-2-add-structured-testing-to-your-ai-prompt-vibe/Sun, 31 Aug 2025 00:00:00 +0000https://dennis-whalen-dot-com.vercel.app/blog/ai/promptfoo/promptfoo-2-add-structured-testing-to-your-ai-prompt-vibe/ When building AI applications with LLMs, many teams are still "vibe testing" their way to production. This guide shows how file-based prompts and comprehensive test scenarios build reliable review analysis systems that handle real-world complexity, allowing you to build a solid set of repeatable automated regression tests.https://dennis-whalen-dot-com.vercel.app/blog/ai/promptfoo/promptfoo-1-testing-custom-llm-prompts/Sat, 23 Aug 2025 00:00:00 +0000https://dennis-whalen-dot-com.vercel.app/blog/ai/promptfoo/promptfoo-1-testing-custom-llm-prompts/ LLMs produce non-deterministic outputs, making traditional exact-match testing ineffective. How can you verify an application response is contextually accurate when the response can vary with every request? Let's take a look at promptfoo!