Blog Layout

Putting agentic AI to the test

Bill Doerrfeld | February 28, 2025

The latest edition of DirectorPlus explores how New Relic is utilizing agentic AI and what the results have been.


A lot is being said about agentic AI right now. But is it all hype?


I recently synced with Camden Swita, Head of AI and ML Innovation at New Relic, on this loaded topic for LeadDev — we dove into the details to explore how New Relic developers are actually putting it to the test and seeing real-world results.


This one is loaded with on-the-ground insights. For instance, I never dreamed image-to-text models would outperform raw text for things like navigating a database schema!


Success with agentic AI involves tracking the right metrics, bridging deterministic and probabilistic AI, getting input from various domain experts, and discovering new optimizations, says Camden.


Finding success with AI is a moving target, especially with mounting quality concerns. So, it's fascinating to see how agentic AI is being approached in real-world settings.


Check out the full story on LeadDev! And be sure to subscribe to DirectorPlus if you'd like this monthly column in your inbox. 


Featured image credit: Cash Macanaya on Unsplash.


Read: AI agents and the missing link in DevOps

Sign up to the DirectorPlus newsletter for a new story in your inbox each month featuring on-the-ground insights from some of the industry's top engineering leaders. Or, if you would like to be featured in the series, please read this.

Can LLMs accelerate requirements engineering?
By Bill Doerrfeld March 6, 2025
New research shows LLMs outperform humans in software requirements engineering, reducing weeks of work to seconds while improving completeness by 10.2%.
Infoworld feature on ebpf and container networking
By Bill Doerrfeld March 3, 2025
Containers are designed to be isolated—that's great for security but tricky for networking. My feature with InfoWorld explores how eBPF is evolving container networking.
Study reveals growing technical debt in AI age
By Bill Doerrfeld February 19, 2025
The 2nd annual code quality report from GitClear found 10x more duplicated code than two years ago and fewer signs of code reuse than ever before.
Kubernetes usability InfoWorld pilot cockpit Doerrfeld
By Bill Doerrfeld February 10, 2025
My feature on InfoWorld explores the state of Kubernetes usability, highlighting various advancements across workload types, support for edge and AI, and new features like observability and security.
Carving out time for large-scale engineering chores
By Bill Doerrfeld January 31, 2025
It's up to leadership to help prioritize large-scale engineering updates that keep software running smoothly. Kent Wills, Director of Engineering at Yelp, provides insight on the latest DirectorPlus.
5 potential use cases for Arazzo
By Bill Doerrfeld January 30, 2025
Italian for “tapestry,” Arazzo is aptly named since it can be used to weave together sequences of API calls to illustrate a specific business pattern.
How genAI can aid Kubernetes troubleshooting
By Bill Doerrfeld December 23, 2024
I caught up with CTO Itiel Shwartz about leveraging finely tuned models like Komodor’s KlaudiaAI agent for ultra-specific DevOps challenges, like Kubernetes error diagnosis and remediation challenges.
Framing AI in the right light
By Bill Doerrfeld December 20, 2024
Rolling out AI is all about framing it in a positive light, says GitLab's CTO, Sabrina Farmer. I interviewed her for the latest edition of DirectorPlus for LeadDev, which is out today.
What's on the top of CIOs' minds lately? Resilience.
By Bill Doerrfeld December 19, 2024
Surmounting risks are encouraging CIOs to future-proof and update their resilience strategies. My latest feature for CIO.com explores resilience head-on.
DX Core 4 unifies developer productivity frameworks
By Bill Doerrfeld December 10, 2024
Today, DX debuted a new developer productivity framework, DX Core 4. Excited to break the news with LeadDev, interviewing one of the designers of the framework.
More Posts
Share by: