Many data technologists are feeling pressure around the realities and real-life considerations of building out a data stack that can handle the next generation of data problems in addition to today's data challenges. Considerations like minimizing complexity and cost while focusing on scalability and performance are at the forefront of the data world right now, and how this works in a world where LLMs and deep learning are becoming table stakes is paramount. There are questions about data management at this scale as well - e.g. how do you fold this into a Data Mesh, or use Data Products? We'll discuss the modern AI data stack in this talk, going fairly deep on where the industry is now, and how to think through architecting the data ecosystem of the future.
