Three Weird Tips for High Performance Analytics Applications
Gian Merlino | Imply
ABOUT THE TALK
On the Druid project, our goal is to build the engine that powers your analytics applications. Apps like interactive dashboards, slice-and-dice tools, and real-time monitoring systems, all need to respond quickly in order to be effective. This talk is about three of the virtues that keep analytic apps running smoothly. (And they're not that weird, we promise!)
In this talk, we'll discuss:
1. The virtue of brevity: it's best known as the soul of wit, but is also your gateway to the performance-enhancing benefits of compression. 2. The virtue of foresight: thinking ahead and storing rollups of your data saves work at query time. 3. The virtue of cleverness: sketches and approximate algorithms can get you results fast, cheap, and 98% right.
Download Slides
Gian Merlino
Co-Founder | Imply
Gian is the co-founder at Imply. Previously he led the development of the streaming data ingestion and processing stack, which handles tens of billions of new events every day at Metamarkets. He also worked at Yahoo where he worked on Yahoo's worldwide server deployment and configuration management platform, which touched nearly every production server.
Experience more insightful data science & engineering talks at DataEngConf NYC '17
