Why Nextdoor Ditched A Data Warehouse for A Centralized Data Lake

Discover how Nextdoor transitioned from a traditional data warehouse to a centralized data lake leveraging Qubole’s cutting-edge cloud infrastructure. In this insightful webinar presented by Ivan Peng, a software engineer at Nextdoor, you’ll learn about the challenges faced with scaling data analytics and BI, and how a strategic shift to Qubole helped overcome these obstacles, enabling efficient, scalable data processing.

What You’ll Learn:

  1. Challenges with Traditional Data Warehouses:
    • Understand the scalability and cost challenges faced by Nextdoor with their existing Redshift data warehouse setup.
  2. Transitioning to a Centralized Data Lake:
    • Discover the reasons behind Nextdoor’s shift towards a storage-only data lake, with Qubole as the compute engine, and how it simplified their data architecture.
  3. Benefits of Using Presto on Qubole:
    • Learn about the advantages of using Presto on Qubole for data processing, including flexibility, scalability, and cost-efficiency.
  4. Democratization of Data Access:
    • See how Nextdoor democratized data access across the company, enabling deeper data exploration and analysis without the need for engineering intervention.
  5. Achieving Feature Parity and Performance:
    • Explore the solutions implemented to replicate read isolation and secure permissions within the new data lake environment.
  6. Future Directions and Performance Improvements:
    • Gain insights into Nextdoor’s future plans to further enhance their data processing capabilities and explore potential performance gains.

Please fill in the form to watch the webinar

Note: By filling and submitting this form you understand and agree that the use of Qubole’s website is subject to the General Website Terms of Use. Additional details regarding Qubole’s collection and use of your personal information, including information about access, retention, rectification, deletion, security, cross-border transfers and other topics, is available in the Privacy Policy. If you have any questions regarding the webform language, please contact [email protected].