Connecting the Data: Data Integration Techniques for Building an Operational Data Store (ODS), by Angelo Bobak
Business data integration is a complex problem that must be solved when organizations change or enhance their internal structures. The goal of this book is to present a simple yet thorough resource that describes the challenges of business data integration and the solutions to these challenges such as schema integration, illustrated through an Operational Data Store (ODS) case study.
CHAPTER 1: Introduction and Roadmap
What exactly is an ODS?
A Guided Tour of the Book
Introducing our Case Study Architecture
Summary
CHAPTER 2: What is an Operational Data Store?
The High Level Operational Data Store Architecture
The ODS Data Staging Layer
ODS Data Profiling
ODS Data Cleansing
ODS Data Integration
Making ODS Data Available to Other Systems
Summary
CHAPTER 3: What is Schema Integration?
Binary Schema Integration – Technique 1
Binary Schema Integration – Technique 2
Binary Schema Integration – Technique 3
Summary
CHAPTER 4: Roles of the ODS within Data Warehouse Architectures
As a Supplier for a Data Warehouse
As a Supplier for Multiple Data Marts
As a Member in a Distributed Architecture
As a Source for Operational Reporting
As a Source for Data Mining Applications
As an Integrator of CMDB Data
As a Data Quality Platform
Summary
CHAPTER 5: Reverse Engineering the Four Schema
Reverse Engineering the Munich Database
Reverse Engineering the London Database
Reverse Engineering the Torino Database
Reverse Engineering the Paris Database
Summary
CHAPTER 6: Designing the Interim Schema
Reviewing the Data Models
Defining the Integration Sequence
Integration Sequence 1 – Analysis & Conflict Resolution for Customer
Integration Sequence 2 – Analysis & Conflict Resolution for Product
Integration Sequence 3 – Analysis & Conflict Resolution
Integration Sequence 4 – Analysis & Conflict Resolution
Integration Sequence 5 – Analysis & Conflict Resolution for Inventory Address
Integration Sequence 6 – Analysis & Conflict Resolution for Order Line
The Final Conceptual Model
Summary
CHAPTER 7: Preparing the ETL Specifications
The Customer ETL Specifications
The Product ETL Specifications
The Inventory ETL Specifications
The Order Header ETL Specifications
The Order Line ETL Specifications
Process Hierarchy Diagram
Process Dependency Diagram
Summary
CHAPTER 8: Designing the Physical ODS Database Model
Customer Physical Model and DDL
Product Physical Model and DDL
Inventory Physical Model and DDL
Order Header Physical Model and DDL
Order Line Physical Model and DDL
Summary
CHAPTER 9: Creating our ETL Processes with SSIS
Implementation Strategy
Loading the Staging Tables
Loading the Reference Tables
Loading Integrated Schema 1 (IS1)
Loading Integrated Schema 2 (IS2)
Loading Integrated Schema 3 (IS3)
Deploying the Completed Packages
Summary
CHAPTER 10: Data Quality Profiling
Data Profiling
Fuzzy Matching
Creating a Data Quality Report Model
Creating a Data Quality Report
Summary
Please complete all fields.