Skip to content

gronnerup/AquaShack

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

AquaShack

This is a pico-example of a meta-data driven lakehouse for Microsoft Fabric. For a full scale solution, I recommend twoday's AquaVilla best practices.

Installation

/Setup.ipynb holds all to get started. It is one script, to setup the full example.

NB! 2025-02-07: There has been fixed a concurrency issue, where transformations could leak data to other transformations. There is tiny minor risc of experince this. Re-running the /Setup.ipynb notebook fixes this.

Documentation

AquaShack is traditionel medallion architecture, due to history the Bronze, Silver and Gold layers are named Landing, Base and Curated.

When installed, the notebook 1_AquaShack_Landing_To_Base will move example data from Landing to Base. The notebook 2_AquaShack_Base_To_Curated will move data from Base to Curated.

image

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Jupyter Notebook 100.0%