Blog Layout

Putting agentic AI to the test

Bill Doerrfeld | February 28, 2025

The latest edition of DirectorPlus explores how New Relic is utilizing agentic AI and what the results have been.


A lot is being said about agentic AI right now. But is it all hype?


I recently synced with Camden Swita, Head of AI and ML Innovation at New Relic, on this loaded topic for LeadDev — we dove into the details to explore how New Relic developers are actually putting it to the test and seeing real-world results.


This one is loaded with on-the-ground insights. For instance, I never dreamed image-to-text models would outperform raw text for things like navigating a database schema!


Success with agentic AI involves tracking the right metrics, bridging deterministic and probabilistic AI, getting input from various domain experts, and discovering new optimizations, says Camden.


Finding success with AI is a moving target, especially with mounting quality concerns. So, it's fascinating to see how agentic AI is being approached in real-world settings.


Check out the full story on LeadDev! And be sure to subscribe to DirectorPlus if you'd like this monthly column in your inbox. 


Featured image credit: Cash Macanaya on Unsplash.


Read: AI agents and the missing link in DevOps

Sign up to the DirectorPlus newsletter for a new story in your inbox each month featuring on-the-ground insights from some of the industry's top engineering leaders. Or, if you would like to be featured in the series, please read this.

LLMs can now cite their sources
By Bill Doerrfeld April 9, 2025
My latest post on The New Stack reveals how researchers pinpoint the exact sources behind chatbot responses.
Exploring alternative managed Kubernetes platforms
By Bill Doerrfeld March 31, 2025
The Kubernetes ecosystem has exploded with managed platforms tailored to multi-cloud, edge, on-prem, and regional deployments.
Bringing internal engineering gems into the light
By Bill Doerrfeld March 28, 2025
Some internal projects are too good to stay hidden. For DirectorPlus, Spotify's Pia Nilsson shares how to identify and externalize internal platforms — like they did with Backstage.
Why AI-generated code is not enough
By Bill Doerrfeld March 17, 2025
My latest feature for InfoWorld looks into the gaps surrounding AI-generated code and what leaders believe we need to improve the status quo.
Can LLMs accelerate requirements engineering?
By Bill Doerrfeld March 6, 2025
New research shows LLMs outperform humans in software requirements engineering, reducing weeks of work to seconds while improving completeness by 10.2%.
Infoworld feature on ebpf and container networking
By Bill Doerrfeld March 3, 2025
Containers are designed to be isolated—that's great for security but tricky for networking. My feature with InfoWorld explores how eBPF is evolving container networking.
Study reveals growing technical debt in AI age
By Bill Doerrfeld February 19, 2025
The 2nd annual code quality report from GitClear found 10x more duplicated code than two years ago and fewer signs of code reuse than ever before.
Kubernetes usability InfoWorld pilot cockpit Doerrfeld
By Bill Doerrfeld February 10, 2025
My feature on InfoWorld explores the state of Kubernetes usability, highlighting various advancements across workload types, support for edge and AI, and new features like observability and security.
Carving out time for large-scale engineering chores
By Bill Doerrfeld January 31, 2025
It's up to leadership to help prioritize large-scale engineering updates that keep software running smoothly. Kent Wills, Director of Engineering at Yelp, provides insight on the latest DirectorPlus.
5 potential use cases for Arazzo
By Bill Doerrfeld January 30, 2025
Italian for “tapestry,” Arazzo is aptly named since it can be used to weave together sequences of API calls to illustrate a specific business pattern.
More Posts
Share by: