Note: Meeting Room 7 will be available as an On-Call Room for attendees.

Back To Schedule
Wednesday, August 30 • 12:00 - 12:30
Want to Solve Over-Monitoring and Alert Fatigue? Create the Right Incentives!

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Telemetry monitors and their (constant) beeping is a pretty common sight in hospitals. I saw these at the NICU where my twins were being cared for after being born prematurely. My wife and I used to freak out every time one of these went off. Unlike a missed alarm that said your site's down, failing to act on an alarm at a hospital can have much more critical consequences; in 2010 at a hospital in Massachusetts, a patient's death was directly linked to telemetry monitoring after alarms signaling a critical event went unnoticed by 10 nurses.

I attempted to solve this problem when I joined Zynga (in 2013) as the head of SRE. I will go over our failed attempts including filtering the noise, adding heads, building more tools, etc. Will also cover how I came up with an initiative called "clean room" as a way to incentivize engineering teams to keep the noise levels low. Finally, go over some of the tactics that worked (and ones that didn't).

Most people I spoke to about "clean room" almost always walked away having learned something (some have said it's common sense). Share, learn, ask questions, participate - I'll try to make it fun!


Kishore Jalleda

Yahoo, Inc.
Kishore Jalleda is currently the head of production engineering in the Americas in Yahoo’s Publisher Products unit, which includes many popular destinations like Yahoo.com, Yahoo Finance, Yahoo Sports, Yahoo News and Flurry. Previously, Kishore was the head of SRE at Zynga and worked... Read More →

Wednesday August 30, 2017 12:00 - 12:30 IST
Lansdowne Room