Developer Autonomy
Breakout Session
all levels
From Alerts to Autonomy: Scaling Incident Management at PUBG with Automation and AI
TBD 01:00 PM – 01:40 PM
Speakers
Junghun Kim, DevOps Engineer, Krafton Inc.
Back to Catalog
Ship Reliable AI Faster: How to Operate AI Agents with Control and Confidence
About this Session
Replace "AI shipped on hope" with an operating model that holds up once real users depend on it. AI quality is multi-dimensional, covering accuracy, tone, safety, and faithfulness to user data, and can't be debugged from outputs alone. Without visibility into what their AI actually did in production, teams miss regressions, reverse-engineer chains by hand, and watch a single bad answer erode trust built over hundreds of right ones.
We'll walk through how to operate AI with the same discipline you apply to any production system, anchored in LLM Observability. Start by tracing every prompt, retrieval, and tool call end-to-end so you can see what your agents did and why. Production traffic then becomes your evaluation dataset, replacing synthetic tests that age the moment users do something unexpected. Structured experiments let you compare prompt and model variants with confidence before changes reach users. You'll also see how to catch regressions in quality, latency, and cost before users feel them, connect AI behavior to the rest of your stack, and equip every team shipping agents to own their reliability.
Attendees will leave able to define quality for their AI, investigate faster when outputs look wrong, and ship updates engineering and reliability teams can trust.
Related Sessions
Harnessing AI
Breakout Session
all levels
LLM Observability at Scale: Governing, Monitoring, and Securing AI Agents in Production
TBD 09:00 AM – 09:40 AM
Speakers
Rodrigo Moreno, Head of Cloud & SRE, Banco BV
Flávia Sacramoni, Head of Command Center and IT Services Management, Banco BV
End-to-End Observability
Harnessing AI
Workshop
Build with LLM Observability: From Setup to Signal - Pre-Day
TBD 01:30 PM – 04:00 PM
End-to-End Observability
Harnessing AI
Developer Autonomy
Datadog Core Skills for Developers - Pre-Day
TBD 01:30 PM – 04:00 PM
End-to-End Observability
Harnessing AI
Scaling Systems
Datadog Core Skills for Site Reliability Engineers (SREs) - Pre-Day
TBD 01:30 PM – 04:00 PM
Developer Autonomy
Workshop
intermediate
Read Between the Stack Traces: Investigations with Continuous Profiler
TBD 01:30 PM – 04:00 PM
Security & Compliance
Harnessing AI
Breakout Session
BewAIre: Detecting Malicious Pull Requests at Scale with LLMs
TBD 01:00 PM – 01:40 PM
Speakers
D Niu, Senior Software Engineer, Datadog
Kassen Qian, Senior Product Manager, Datadog
Harnessing AI
Breakout Session
all levels
LLM Observability at Scale: Governing, Monitoring, and Securing AI Agents in Production
TBD 09:00 AM – 09:40 AM
Speakers
Rodrigo Moreno, Head of Cloud & SRE, Banco BV
Flávia Sacramoni, Head of Command Center and IT Services Management, Banco BV
Harnessing AI
Fireside Chat
all levels
The New Shape of Engineering
TBD 01:00 PM – 01:40 PM
Speakers
Alexis Lê-Quôc, CTO & Co-Founder, Datadog
Thibault Sottiaux, Head of Codex, OpenAI
End-to-End Observability
Harnessing AI
Workshop
Build with LLM Observability: From Setup to Signal - Pre-Day
TBD 01:30 PM – 04:00 PM
End-to-End Observability
Harnessing AI
Developer Autonomy
Datadog Core Skills for Developers - Pre-Day
TBD 01:30 PM – 04:00 PM
End-to-End Observability
Harnessing AI
Scaling Systems
Datadog Core Skills for Site Reliability Engineers (SREs) - Pre-Day
TBD 01:30 PM – 04:00 PM
Developer Autonomy
Breakout Session
all levels
From Alerts to Autonomy: Scaling Incident Management at PUBG with Automation and AI
TBD 01:00 PM – 01:40 PM
Speakers
Junghun Kim, DevOps Engineer, Krafton Inc.
End-to-End Observability
Harnessing AI
Developer Autonomy
Datadog Core Skills for Developers - Day 1
TBD 02:00 PM – 04:30 PM
End-to-End Observability
Harnessing AI
Developer Autonomy
Datadog Core Skills for Developers - Pre-Day
TBD 01:30 PM – 04:00 PM
End-to-End Observability
Developer Autonomy
Workshop
Delivering High Quality Software with APM and Distributed Tracing
TBD 09:00 AM – 11:30 AM
End-to-End Observability
Security & Compliance
Harnessing AI
From Commit to Runtime: Secure Software Delivery and Automated Response with Datadog
TBD 02:00 PM – 04:30 PM
Developer Autonomy
Workshop
intermediate
Read Between the Stack Traces: Investigations with Continuous Profiler
TBD 01:30 PM – 04:00 PM
Developer Autonomy
Breakout Session
all levels
From Alerts to Autonomy: Scaling Incident Management at PUBG with Automation and AI
TBD 01:00 PM – 01:40 PM
Speakers
Junghun Kim, DevOps Engineer, Krafton Inc.
Harnessing AI
Breakout Session
all levels
LLM Observability at Scale: Governing, Monitoring, and Securing AI Agents in Production
TBD 09:00 AM – 09:40 AM
Speakers
Rodrigo Moreno, Head of Cloud & SRE, Banco BV
Flávia Sacramoni, Head of Command Center and IT Services Management, Banco BV
End-to-End Observability
Harnessing AI
Workshop
Build with LLM Observability: From Setup to Signal - Pre-Day
TBD 01:30 PM – 04:00 PM
End-to-End Observability
Harnessing AI
Developer Autonomy
Datadog Core Skills for Developers - Pre-Day
TBD 01:30 PM – 04:00 PM
End-to-End Observability
Harnessing AI
Scaling Systems
Datadog Core Skills for Site Reliability Engineers (SREs) - Pre-Day
TBD 01:30 PM – 04:00 PM
Developer Autonomy
Workshop
intermediate
Read Between the Stack Traces: Investigations with Continuous Profiler
TBD 01:30 PM – 04:00 PM