🪴 TJ's Notes 1.0

Data Warehousing and Mining Lecture 7

1 min read

Data Warehouse Architecture

Data is stored in the ETL process.

ETL Process:

  1. Extraction - Data is extracted from various heterogeneous data sources, such as:

    • Production data
    • Operational data
    • Databases
    • Enterprise data, etc.

  2. Transformation - The extracted data is transformed and stored in a standardized data format into:

    • Several data marts
    • Corresponding metadata

  3. Loading - The transformed data is loaded into the data warehouse and data mining software to generate:

    • Consolidated data reports
    • Further analytics

Overview of the Components

  • Source Data Component

    • Production data
    • Internal data
    • Archive data
    • External data

  • Data Staging Component

    • Extraction
    • Transformation
      • Cleaning
      • Standardization
    • Loading

  • Data Storage Component

  • Information Delivery Component

  • Metadata Component

  • Management and Control Component

Metadata Definition:

Metadata refers to the data report describing the data stored in the data mart and the data warehouse.

References

Information
  • date: 2025.01.29
  • time: 13:15

Graph View

Backlinks