With the surge in big data and AI, organizations can rapidly create data products. However, the effectiveness of their analytics and machine learning models depends on the data's quality. Delta Lake's open source format offers a robust lakehouse framework over platforms like Amazon S3, ADLS, and GCS.
This practical book shows data engineers, data scientists, and data analysts how to get Delta Lake and its features up and running. The ultimate goal of building data pipelines and applications is to gain insights from data. You'll understand how your storage solution choice determines the robustness and performance of the data pipeline, from raw data to insights.
You'll learn how to:
Use modern data management and data engineering techniquesUnderstand how ACID transactions bring reliability to data lakes at scaleRun streaming and batch jobs against your data lake concurrentlyExecute update, delete, and merge commands against your data lakeUse time travel to roll back and examine previous data versionsBuild a streaming data quality pipeline following the medallion architecture
You can read this ebook online in a web browser, without downloading anything or installing software.
This ebook is available in file types:
This ebook is available in:
After you've bought this ebook, you can choose to download either the PDF version or the ePub, or both.
The publisher has supplied this book in DRM Free form with digital watermarking.
You can read this eBook on any device that supports DRM-free EPUB or DRM-free PDF format.
The publisher has supplied this book in encrypted form, which means that you need to install free software in order to unlock and read it.
To read this ebook on a mobile device (phone or tablet) you'll need to install one of these free apps:
To download and read this eBook on a PC or Mac:
The publisher has set limits on how much of this ebook you may print or copy. See details.