“Mediator” is an analytics service. It currently serves more than 300 customers. For each of them “Mediator” collects around 10 events per user. This adds up to 1.3 billion events daily. We collect, analyze and store data in real time. The core of “Mediator” is a tricky combination of nginx & Tarantool.
How to cope with such a hogh load? How to collect data fast and safely? How to minimize ssl overhead? How to save & process millions of records per minute without a huge fleet of machines?
Pavel will share answers to all these questions during his report.
He creates a highload and high-avaliable project with NGINX and UWSGI. Pavel knows how to write failover applications and can write assynchronous (AnyEvent, Coro) and parallel (fork, threads) code. Besides, he has experience in database schemas design, difficult SQL queries and index optimisation.
In his free time, Pavel currently works on an app that will help people to find the best place to eat according to their interests and mood. Students of Bauman State Unversity attend his regular Database class. Moreover, Pavel is a leader of Moscow.pm (moscow perl mongers group) and organisator of a lot of perl meetups and conferences (YAPC::Russia 2015 and YAPC::Russia 2016 ).
Company: «Mail.ru Group», Russia