Loading…

Note: Meeting Room 7 will be available as an On-Call Room for attendees.

Back To Schedule
Wednesday, August 30 • 15:40 - 16:10
Capturing and Analyzing Millions of Queries without Any Overhead

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

This talk is about a new way of monitoring and analyzing millions of queries with no overhead.

Optimizing queries is the most important aspect of scaling database servers. Before we can optimize, we need to identify the problematic queries. We have slow-query log in MySQL where we can set a threshold and all the queries crossing threshold will be logged in a file and later can be used for analysis. Other way is to use performance_schema database inside MySQL which gives various metrics of queries.

The problem is that enabling the slow query log will incur a 25-35% overhead on the database, since we have to have to write to a file. Additionally, since only queries exceeding the threshold will be logged, we won't have any data about queries below that threshold. Meanwhile, enabling performance_schema incurs a 10-20% overhead, and is complex to understand.

To minimize overhead and effectively measure all queries, we have built a query analyzer which incurs less than 3% CPU overhead and no overhead on any other resources.

Speakers
avatar for Karthik Appigatla

Karthik Appigatla

Staff SRE, LinkedIn
Karthik Appigatla has been working on various large scale data stores for a decade primarily focused on MySQL. Currently, he has been working for LinkedIn for the last 5 years. Prior to LinkedIn, he worked for Yahoo, Pythian and Percona where he was responsible for helping clients... Read More →
BT

Basavaiah Thambara

Sr. Database Engineer, LinkedIn
Basavaiah Thambara (Basu) has decade of experience designing, building and scaling MySQL databases. He is currently working as a staff database engineer at LinkedIn managing Espresso, an in-house distributed NoSQL datastore. He currently lives in Bangalore,India https://in.linked... Read More →


Wednesday August 30, 2017 15:40 - 16:10 IST
Pembroke Room