- Introduction
- What are we getting into?
- Quick note on the commonly asked questions.
- The Architecture which will be used for this course
- Different stages of the Architecture
Online
₹ 449 3,499
Quick facts
particular | details | |
---|---|---|
Medium of instructions
English
|
Mode of learning
Self study
|
Mode of Delivery
Video and Text Based
|
Course and certificate fees
Fees information
certificate availability
certificate providing authority
The syllabus
Getting Started
Metadata Categories
- Business Metadata
- Technical Metadata
- Operational Metadata
ETL Framework - Process Flow
- ETL Framework - The Process Flow
Data Sourcing
- What is Data Sourcing?
- What are the different events of Data Sourcing?
- Scheduled Events
- CDC - Change Data Capture Events
- Pub - Sub Events
- WebServices/API Events
Data Sourcing - Classification
- Push and Pull
- Architectural Classification
Scripts Requirements for Data Sourcing
- What functionality should be part of the Scripts for Data Sourcing?
File Validation
- File Validation Process
- Post File Validation Steps
- File Validation Failure Notifications
The Staging Layer
- What is the need for a Staging layer?
- What is Reference Data and Should it be stored in the Staging Layer?
- Different Real time examples of Reference Data Set up and Usage.
- Are Audit columns required for the Staging and Reference Data?
- How many days of data should be stored in the staging area?
- Do we need to set up the Partitions based on the Data Retention?
- What kind of DB Standards should be followed for the Staging area setup?
Business Validation Layer
- What is the the Business Validation Layer?
- Different situations possible during the data processing at this layer
- Indirect Data Load Porcess - Using Informatica
- Concurrent Workflow Process
- Partitions in Stage Layer and Business Validation Layer
Data Warehouse Layer
- Dimension Load
- Fact Load Process
- Fact Partitions/ Fact Summary Load
- Fact Summary Load
- Source File Managment/Archival
Exception Handling/Error Handling
- Data Model for Exception Handling
- Error Category
- Error Code
- Different Solutions for Exception handling
Project Setup
- Steps to download the sample project and the codebase
- Importing and Creting the Database metadata and the sample data
- Project explanation and aligning to the architecture
- Review of the project and the code base
Extending the Operational Metadata's Data Model
- Supporting Operational Metadata for Exception Handling
- Additional tables required to support the Exception Handling
- Why do we need so many tables?
Error Handing Data Model
- System Stage Table
- Data Source Metadata Table
- Data Source Detail Table
- Data Source System Table
- Job Details Table
- Changes to the Error Log Table
Mapping Example
- Modify the existing mapping to load the wrong data into the ERROR_LOG Table
- Other Possible ways of implemeting the Error handling
- Using PMREP Tables for Error Handling
Audit Balance and Control
- Metadata Management
- Need for Operational Metadata
- Different technical components involved for Audit Balance and Control
- Table Structure for Audit Balance and Control
- Structure of the Workflow with the re-usable sessions
- RUN_ID, the Unique Attribute
- The Re-usable Stored Procedure
- Sequence Generator with Trigger
- Workflow Setup
- Assignments and What else is left?
Configuration Management
- What is Configuration Management?
- What are the different subject areas under Configuration Management?
- Incident Management
- Change Management
- Release Management
- Capacity Management
- Service Level Management
- Disaster Recovery and Availability Management
Instructors
Mr Sid Inf
Instructor
Freelancer