When Prateek Chawla, founding engineer, joined Monte Carlo in 2019, he was responsible for spinning up our data platform from scratch. He was more of a backend/cloud engineer, but like with any startup had to wear many hats, so got the opportunity to play the role of data engineer too. In this talk, we’ll walk through how we spun up Monte Calro’s data stack with Snowflake, Looker, and dbt, touching on how and why we implemented dbt, key use cases, and handy tricks for integrating dbt with other popular tools, like Airflow, and Spark. We’ll discuss what worked, what didn’t work, and other lessons learned along the way, as well as share how our data stack evolved over time to scale to meet the demands of our growing startup. We’ll also touch on how teams can scale stake reliability with testing, data observability, and circuit breakers.
Prateek Chawla is a founding engineer and technical lead at Monte Carlo, where he drives the technical strategy for their data observability platform. Previously, he served as a technical lead at Barracuda, working on email fraud prevention technologies. He graduated Summa Cum Laude with a B.S. in Computer Science and Engineering from the University of California, Santa Cruz. In his free time, Prateek enjoys watching Broadway shows, flying airplanes, reading, and exploring new places.