Managing Transactions in Data Lakes

Discover how Qubole is revolutionizing data management in cloud data lakes with our advanced transactions and multi-versioning capabilities. This webinar, presented by Jody, co-founder and CTO of Qubole, delves into the challenges of managing data in the cloud and introduces Qubole’s innovative solutions. Learn how we enhance data integrity, enable concurrent data processing, and simplify compliance with data privacy regulations.

What You’ll Learn:

  1. Understanding Data Lakes:
    • Get insights into how data is organized in data lakes and the necessity for transactions to ensure data integrity and consistency.
  2. Evolution of Data Management:
    • Explore the historical context and the emergence of solutions like Apache Hudi, Delta Lake, Apache Iceberg, and Qubole’s enhancements to Hive ACID for improved data lake transactions.
  3. Qubole ACID Capabilities:
    • Discover how Qubole extends Hive ACID, offering full transaction support across multiple engines, including Spark and Presto, for comprehensive data operations.
  4. Advanced Features for Robust Data Handling:
    • Learn about our support for ODBC/JDBC drivers, SQL DML statements, automated compactions, and a cloud-agnostic, open-source foundation for reliable data processing.
  5. Technical Deep Dive into Qubole ACID:
    • Gain technical insights into creating ACID tables, understanding storage layout, transactions, multi-versioning, compaction workflows, and enhancements to Spark and Presto for efficient data manipulation.
  6. Future Roadmap:
    • Peek into the future developments of Qubole ACID, including support for indexes, Parquet files, time travel capabilities, and integration with enterprise CDC tools.

 

Please fill in the form to watch the webinar

Note: By filling and submitting this form you understand and agree that the use of Qubole’s website is subject to the General Website Terms of Use. Additional details regarding Qubole’s collection and use of your personal information, including information about access, retention, rectification, deletion, security, cross-border transfers and other topics, is available in the Privacy Policy. If you have any questions regarding the webform language, please contact [email protected].