Your Agent Is Getting Weird: Testing, Observability, and Lifecycle Patterns for Production AI Agents
Date to be announced · Time to be announced
An AI agent can work perfectly in a demo and start acting strange in production. Data changes, retrieval gets stale, tools evolve, permissions shift, models update, workflows move, and users discover edge cases nobody tested. Suddenly the helpful assistant is confidently wrong, calling the wrong API, or giving answers nobody trusts. This session shows developers and architects how to detect and prevent agent weirdness before it becomes operational pain. Samantha will cover practical patterns for testing, evaluation, observability, lifecycle ownership, escalation, governance hooks, and retirement so production agents remain useful, secure, maintainable, and aligned as enterprise reality changes daily. Organizer timezone/event-window conflict: normalized date/time deliberately null. Published local schedule: 13:15–13:45. Timezone requires verification.
Session status: scheduled
Room: MPR A
Saving a session is not registration. Check the official agenda for availability, eligibility and any additional fees.
Speakers and their event affiliations
- Samantha St-Louis (Allegrini)
Affiliation at this event: Global Knowledge
Parent event
In person · Microsoft Toronto, Toronto, Ontario, Canada
This describes the parent event. Confirm the session’s attendance requirements with the organizer.
Companies participating in the parent event
These are event-level relationships, not confirmed sponsorship of this session.