Loading…
This event has ended. Create your own event → Check it out
This event has ended. Create your own
To Learn More: LinuxCon Europe | CloudOpen Europe | Embedded Linux Conference Europe.

Attendees! Please provide us feedback on the sessions you attend! Click here to submit a brief survey for each session and win a $250 Amazon gift certificate. 

>> Tracing Summit: View the Full Schedule

View analytic
Tuesday, October 14 • 3:30pm - 4:20pm
TSAR (TimeSeries AggregatoR) - How to Count Tens of Billions of Daily Events in Real Time Using Open Source Technologies - Anirudh Todi, Twitter

Sign up or log in to save this to your schedule and see who's attending!

Twitter's 250 million users generate over 50 billion tweet views per day. Aggregating these events in real time - in a robust enough way to incorporate into our products - presents a massive scaling challenge. In this talk I'll introduce TSAR (the TimeSeries AggregatoR), a robust, flexible, and scalable service for real-time event aggregation designed to solve this problem and a range of similar ones. I'll discuss how we built TSAR from the ground up, almost entirely on open-source technologies (Storm, Summingbird, Kafka, Aurora, and others), and describe some of the challenges we faced in scaling it to process tens of billions of events per day.

Speakers
avatar for Anirudh Todi

Anirudh Todi

Software Engineering Manager, Twitter Inc
At Twitter, Anirudh works on the Data Platform team. Anirudh and his team are chartered with processing and understanding the vast body of data that is generated by the operation of the Twitter platform. Their technologies are used to build a range of cutting-edge services that can process petabytes of data per month in real time for insights into the usage patterns of the Twitter platform. Anirudh has previously worked at Facebook helping scale... Read More →


Tuesday October 14, 2014 3:30pm - 4:20pm
Room 02