Is Your Data Lake Turning to a Data Swamp?

The Clearly Podcast

04-12-2023 • 31 mins

The podcast discusses the issue of data lakes turning into data swamps due to the uncontrolled dumping of data. While storage is cheap, this can lead to a mess with duplicate and poor-quality data that’s hard to use. Organizations must implement processes to control what data goes into the lake, document where it’s stored, and build a data dictionary. Cleaning up existing data involves removing duplicates and poor-quality data, and appointing a data steward to oversee the process.

There's a need for a cultural shift to focus on data quality rather than quantity. Governance policies, such as data retention and clear ownership, are crucial. Proper data management can be costly but prevents inefficiency and poor decision-making. The importance of having the right foundations, including people, processes, and technology, along with business buy-in, is emphasized.

In conclusion, maintaining a healthy data lake requires well-defined processes, governance, and a culture that values data quality. Next week's topic will cover how to migrate to the cloud, specifically from SQL on-prem to SQL in the cloud.

You can download Power BI Desktop from here.

If you already use Power BI, or are considering it, we strongly recommend you join your local Power BI user group here.

To find out more about our services and the help we can offer, contact us at one of the websites below:
UK and Europe: https://www.clearlycloudy.co.uk/
North America: https://clearlysolutions.net/

You Might Like

Darknet Diaries
Darknet Diaries
Jack Rhysider
Double Tap
Double Tap
Accessible Media Inc.
TechStuff
TechStuff
iHeartPodcasts
Waveform: The MKBHD Podcast
Waveform: The MKBHD Podcast
Vox Media Podcast Network
Fortnite Emotes
Fortnite Emotes
Lawrence Hopkinson
Acquired
Acquired
Ben Gilbert and David Rosenthal
Hard Fork
Hard Fork
The New York Times
Talkin' Shop
Talkin' Shop
Eclipse Automotive Technology
The Vergecast
The Vergecast
The Verge
RNIB Tech Talk
RNIB Tech Talk
RNIB Connect Radio
Smashing Security
Smashing Security
Graham Cluley & Carole Theriault