What is a Lakehouse Anyway?

The Clearly Podcast

18-12-2023 • 24 mins

The podcast discusses the concept of lake houses in data architecture. A lake house integrates a data warehouse with a data lake, providing a more efficient and versatile means of storing and querying data. It follows a Medallion architecture with three layers: bronze for raw data, silver for cleaned and enriched data, and gold for aggregated data suitable for analytics. This structure helps prevent the data swamp issue common in traditional data warehouses.

Using a lake house can be cost-effective, allowing the storage of various data types quickly and inexpensively. It also supports data science applications by retaining raw data needed for detailed analysis. However, it requires additional steps for data transformation, especially for raw data.

Switching from an existing data warehouse to a lake house should be part of a larger transformation plan, done incrementally to ensure a smooth transition. For new setups, a lake house should be considered if large data volumes are expected, while traditional data warehouses might still be suitable for smaller organizations with existing SQL skills.

Modern tools like Azure Data Lake and Fabric can streamline the process, helping organizations achieve a single version of the truth. The discussion emphasizes the importance of evaluating organizational needs and available resources before deciding on the best data architecture solution.

You can download Power BI Desktop from here.

If you already use Power BI, or are considering it, we strongly recommend you join your local Power BI user group here.

To find out more about our services and the help we can offer, contact us at one of the websites below:
UK and Europe: https://www.clearlycloudy.co.uk/
North America: https://clearlysolutions.net/

You Might Like

Darknet Diaries
Darknet Diaries
Jack Rhysider
Double Tap
Double Tap
Accessible Media Inc.
TechStuff
TechStuff
iHeartPodcasts
Waveform: The MKBHD Podcast
Waveform: The MKBHD Podcast
Vox Media Podcast Network
Fortnite Emotes
Fortnite Emotes
Lawrence Hopkinson
Acquired
Acquired
Ben Gilbert and David Rosenthal
Hard Fork
Hard Fork
The New York Times
Talkin' Shop
Talkin' Shop
Eclipse Automotive Technology
The Vergecast
The Vergecast
The Verge
RNIB Tech Talk
RNIB Tech Talk
RNIB Connect Radio
Smashing Security
Smashing Security
Graham Cluley & Carole Theriault