Extract, Transform and Load

GROWING This note is being developed. It is readible but changes are being applied.
wiki/data-warehouse/extract-transform-load.md Current Note ID: The unique ID of this note.
#Data Warehouse #ETL

Many organizations are talking about ELT instead of ETL nowadays

ETL Process

ETL

ETL

  1. Extract: extract data from sources
  2. Transform: transform it to proper format
  3. Load: load it to data storage infrastructure

E for Extract

  1. Should not affect the source system.

T for Transform

  1. Cleaning
  2. Filtering
  3. Enriching
  4. Splitting
  5. Joining

L for Load

Deal with sync and waiting

Planted: by ;

References:
  1. Data Mining by Jiawei Han, Micheline Kamber, Jian Pei
  2. ETL (Extract, Transform, and Load) Process & Concept
  3. Designing Data-Intensive Applications
  4. Design and Build a Data Warehouse for Business
Similar Articles:
Data Storage
tl;dr: Use type safe formats such as HDF5 or parquet HDF5 BCOLZ …
Some Concepts about Data Warehouse
The Three Key Ideas about Warehouse The purpose of the data warehouse should be clear. In most …

L Ma (2018). 'Extract, Transform and Load', Datumorphism, 11 April. Available at: https://datumorphism.leima.is/wiki/data-warehouse/extract-transform-load/.