Improving Recover Partitions Performance with Spark on Qubole
|May 14, 2019
For most of our customers, an object storage service such as Amazon S3 is the source of truth for their data, rather than the Hadoop…
Prakhar Jain
Using Direct Writes to Significantly Increase the Performance of Spark Workloads
|January 24, 2019
Extract, Transform, Load (ETL) workloads are an important use case of Apache Spark for Qubole customers. In particular, the performance of INSERT INTO / OVERWRITE…
Exploiting AWS Spot Instance Termination Notifications in Qubole
|July 23, 2018
The seamless use of AWS Spot Instances for Apache Spark, Hive, and Presto has been a marquee feature of Qubole’s AWS offering since 2015. We…
