SQL Server Integration Services (SSIS): Developing a SQL Data Warehouse

Inquire now

This course covers the design, development, and operation of a SQL Server data warehouse using SQL Server Integration Services (SSIS). Participants learn to design dimensional data models, integrate data from multiple sources, and develop extract, transform, and load (ETL) processes that populate fact and dimension tables.

The course progresses from data warehousing fundamentals to incremental loading, data quality controls, error handling, deployment, monitoring, and performance optimization. It focuses on SQL Server relational data warehouses and SSIS package development.

Duration 5 Days – 35 hrs.

Objectives

  • Explain data warehouse architecture and the role of SSIS in data integration.
  • Design fact tables, dimension tables, and staging structures.
  • Create SSIS projects, packages, connection managers, and control flows.
  • Develop data flows to extract, cleanse, transform, and load data.
  • Implement full and incremental loading strategies.
  • Manage historical dimension changes using slowly changing dimension patterns.
  • Apply data validation, error handling, logging, and recovery controls.
  • Deploy and configure SSIS projects using the SSISDB catalog.
  • Schedule and monitor package execution.
  • Identify and address common ETL performance bottlenecks.

 

Target Audience 

  • SQL developers and database developers.
  • ETL developers and data integration specialists.
  • Business intelligence developers.
  • Data engineers developing SQL Server data warehouse solutions.
  • Database administrators supporting data integration workloads.
  • Data analysts with SQL experience who are moving into data warehouse development.

 

Prerequisites 

  • Working knowledge of relational database concepts, including tables, keys, relationships, and constraints.
  • Ability to write T-SQL queries using joins, aggregations, subqueries, and data modification statements.
  • Familiarity with SQL Server Management Studio.
  • Basic understanding of views and stored procedures.
  • General familiarity with business reporting requirements is helpful.
  • No previous SSIS development experience is required.

 

Course Outline 

Day 1: Data Warehouse Foundations and SSIS Fundamentals

Module 1: Introduction to SQL Server Data Warehousing

  • Data warehouse purpose and business requirements.
  • Operational databases versus analytical databases.
  • ETL and ELT concepts.
  • Source systems, staging areas, data warehouses, and data marts.
  • Data integration requirements and source-to-target mappings.

 Module 2: Dimensional Modeling

  • Star and snowflake schemas.
  • Defining the grain of a fact table.
  • Fact tables, measures, and dimension tables.
  • Natural keys and surrogate keys.
  • Conformed dimensions and date dimensions.
  • Translating reporting requirements into a dimensional model.

 Module 3: SSIS Architecture and Development Environment

  • SSIS components and package execution concepts.
  • Visual Studio with the SQL Server Integration Services Projects extension.
  • Creating solutions, projects, and packages.
  • Connection managers and data source connectivity.
  • Control flow and data flow fundamentals.
  • Package properties and target server compatibility.

  

Day 2: Developing SSIS Control Flows and Data Flows

Module 4: Building Control Flows

  • Tasks, containers, and precedence constraints.
  • Execute SQL Task and Data Flow Task.
  • Sequence, For Loop, and Foreach Loop containers.
  • File processing and workflow dependencies.
  • Variables, parameters, and expressions.
  • Organizing reusable package workflows.

 Module 5: Extracting and Transforming Data

  • Relational database and flat file sources.
  • Data types, metadata, and conversions.
  • Derived Column and Conditional Split transformations.
  • Lookup transformations and reference data matching.
  • Aggregate, Sort, Merge Join, and Union All transformations.
  • Handling null values and inconsistent source formats.

 Module 6: Loading Staging Tables

  • Designing staging tables.
  • Loading data from multiple sources.
  • Configuring destinations and column mappings.
  • Fast-load options and batch settings.
  • Recording batch identifiers and source metadata.
  • Reconciling source and staging row counts.

  

Day 3: Loading Dimensions and Fact Tables

Module 7: Loading Dimension Tables

  • Initial dimension loading.
  • Generating and resolving surrogate keys.
  • Detecting new and changed records.
  • Slowly changing dimension Types 1 and 2.
  • Managing effective dates and current-record indicators.
  • Handling unknown and inferred dimension members.

 Module 8: Loading Fact Tables

  • Maintaining consistent fact table grain.
  • Resolving dimension keys through lookups.
  • Loading transaction and snapshot fact tables.
  • Handling late-arriving facts and dimensions.
  • Preventing duplicate fact records.
  • Validating measures and referential integrity.

 Module 9: Incremental Loading Strategies

  • Full refresh versus incremental loading.
  • Watermark-based extraction.
  • Introduction to SQL Server Change Tracking and Change Data Capture.
  • Processing inserts, updates, and deletions.
  • Managing load dependencies and control tables.
  • Designing restartable loads that avoid duplicate processing.

  

Day 4: Reliability, Data Quality, and Performance

Module 10: Data Quality and Error Handling

  • Defining validation and data quality rules.
  • Detecting missing, invalid, and duplicate data.
  • Configuring error outputs and redirecting rejected rows.
  • Capturing error details and source record identifiers.
  • Using event handlers.
  • Reprocessing corrected records.

 Module 11: Logging, Auditing, and Recovery

  • SSIS logging and execution diagnostics.
  • Batch audit tables and load status tracking.
  • Recording row counts and reconciliation totals.
  • Transactions and checkpoints.
  • Failure recovery and restart considerations.
  • Troubleshooting validation and runtime errors.

 Module 12: ETL Performance Optimization

  • Identifying source, transformation, and destination bottlenecks.
  • Reducing unnecessary data movement.
  • Understanding blocking and nonblocking transformations.
  • Configuring lookup caching.
  • Managing buffers and execution parallelism.
  • Optimizing bulk loads, indexes, and staging queries.

  

Day 5: Deployment and Operations

Module 13: Deploying and Configuring SSIS Projects

  • Project deployment model.
  • Creating and organizing the SSISDB catalog.
  • Building and deploying project deployment files.
  • Configuring project and package parameters.
  • Managing environments and environment references.
  • Protecting sensitive values and configuring access permissions.

 Module 14: Scheduling and Monitoring ETL Workloads

  • Scheduling package execution with SQL Server Agent.
  • Execution accounts, credentials, and proxies.
  • Configuring job steps and workflow dependencies.
  • Reviewing catalog reports and execution messages.
  • Configuring failure notifications.
  • Managing execution log retention.

 Module 15: Integrating the Data Warehouse Solution

  • Connecting staging, dimension, and fact loading workflows.
  • Coordinating package execution through a master package.
  • Applying environment-specific configurations.
  • Verifying initial and incremental load behavior.
  • Documenting mappings, dependencies, and operational procedures.
  • Preparing the solution for production support.

 

Inquire now

Best selling courses

The Data Analytics with DAX, Python, SQL, and Business Intelligence Tools Training Course provides participants with practical knowledge and skills for collecting, preparing, analyzing, modeling, and visualizing data to support informed business decision-making. The course combines key data analytics technologies and techniques, including Python, SQL, DAX (Data Analysis Expressions), Power BI, data modeling, data transformation,...

The Project Management – SDLC (Software Project Management: The Complete Course) Training Course is a comprehensive program designed to equip project managers, software development leaders, business analysts, product owners, and IT professionals with the knowledge and practical skills required to successfully manage software development projects throughout the entire Software Development Life Cycle (SDLC). This course...

Warehouse Operations and Inventory Management Training Course     Duration 2 Days – 14 hrs.   Overview   This course provides a practical understanding of warehouse operations and inventory management for personnel who supervise, review, or audit warehouse processes. It covers the movement of goods from receiving through dispatch, with emphasis on warehouse layout, storage systems, picking strategies, stock rotation, inventory accuracy, and operational controls.   Participants will learn to identify process weaknesses, investigate stock discrepancies, reduce shrinkage, and interpret warehouse productivity indicators. The course connects day-to-day warehouse activities with the records, controls, and performance measures needed for effective supervision and auditing.   Objectives  

  • Explain warehouse processes and their impact on inventory accuracy and service performance.
  • Evaluate warehouse layouts, storage systems, and product locations.
  • Identify appropriate controls for receiving, put-away, storage, picking, and dispatch.
  • Apply First-In, First-Out (FIFO) and First-Expired, First-Out (FEFO) principles.
  • Compare picking strategies based on order characteristics and operational requirements.
  • Identify causes of inventory discrepancies and recommend corrective actions.
  • Develop a cycle counting approach based on inventory value, movement, and risk.
  • Recognize sources of shrinkage and recommend preventive and detective controls.
  • Interpret warehouse productivity and inventory performance KPIs.
  • Review warehouse processes using supporting records, observations, and control evidence.
        Target Audience  
  • Warehouse supervisors, team leaders, and managers.
  • Inventory controllers and stock control personnel.
  • Logistics and distribution supervisors.
  • Internal auditors and operational compliance personnel.
  • Supply chain and operations professionals.
  • Personnel responsible for reviewing warehouse controls and performance.
  Prerequisites  
  • Basic familiarity with warehouse, logistics, or inventory activities.
  • General understanding of business processes and operational documentation.
  • Basic numerical skills, including percentages and simple calculations.
  • Basic spreadsheet skills are helpful.
  • No prior experience with a specific Warehouse Management System (WMS) is required.
   

Course Outline

  Day 1: Warehouse Processes, Layout, and Storage Controls Module 1: Warehouse Operations and Process Controls  
  • Warehouse roles within the supply chain.
  • End-to-end flow: receiving, put-away, storage, replenishment, picking, packing, and dispatch.
  • Physical stock movement and corresponding system transactions.
  • Responsibilities, authorization, and segregation of duties.
  • Common operational weaknesses and audit evidence.
  Module 2: Warehouse Layout and Storage Systems  
  • Functional zones, movement paths, and space utilization.
  • Receiving, storage, picking, staging, and dispatch areas.
  • Storage options: floor stacking, shelving, pallet racking, and bin storage.
  • Fixed and dynamic location systems.
  • Product slotting based on movement, size, handling needs, and compatibility.
  • Layout bottlenecks and their effects on productivity and inventory control.
  Module 3: Receiving and Put-Away  
  • Purchase orders, delivery documents, and expected receipts.
  • Quantity, condition, and item identification checks.
  • Recording shortages, overages, damage, and discrepancies.
  • Controls for acceptance, quarantine, and release.
  • Put-away rules and location confirmation.
  • Traceability through labels, barcodes, lot numbers, and serial numbers.
  • Timely recording of receipts and stock movements.
  Module 4: Storage, Stock Rotation, and Replenishment  
  • Storage discipline and location integrity.
  • FIFO and FEFO principles, applications, and limitations.
  • Batch, lot, and expiry-date management.
  • Controls for slow-moving, obsolete, damaged, and expired stock.
  • Replenishment of picking locations.
  • Supervision and review of stock rotation compliance.
    Day 2: Order Fulfillment and Inventory Accuracy Module 5: Picking Strategies and Order Fulfillment  
  • Discrete, batch, zone, and wave picking.
  • Selecting picking strategies for different order profiles.
  • Pick paths, location sequencing, and travel reduction.
  • Replenishment coordination and stock availability.
  • Picking verification and error prevention.
  • Packing, staging, and dispatch confirmation.
  • Handling short picks, substitutions, cancellations, and returns.
  Module 6: Inventory Records and Accuracy Controls  
  • Item master data, units of measure, and location records.
  • On-hand, available, allocated, and quarantined stock.
  • Transaction controls for receipts, transfers, issues, returns, and adjustments.
  • Common causes of physical and system stock mismatches.
  • Barcode scanning and WMS control points.
  • Inventory reconciliation and supporting documentation.
  • Measuring inventory accuracy and interpreting discrepancies.
  Module 7: Cycle Counting and Physical Inventory  
  • Cycle counting versus full physical inventory.
  • ABC classification and risk-based count priorities.
  • Count frequency based on value, movement, and discrepancy history.
  • Count preparation, blind counting, and movement controls.
  • Recounts, variance investigation, and adjustment approval.
  • Root cause analysis and corrective action follow-up.
  • Reviewing the effectiveness of the counting program.
  Module 8: Shrinkage Reduction and Inventory Protection  
  • Sources of shrinkage: loss, damage, theft, misplacement, and recording errors.
  • Access controls and accountability for stock movements.
  • Controls for high-value and sensitive inventory.
  • Returns, write-offs, scrap, and disposal controls.
  • Exception reporting and unusual transaction patterns.
  • Investigating recurring losses and unexplained adjustments.
  • Preventive and detective controls for shrinkage reduction.
    Day 3: Performance Management, Process Review, and Improvement Module 9: Warehouse Productivity and Inventory KPIs  
  • Receiving productivity and dock-to-stock time.
  • Put-away productivity and replenishment performance.
  • Picking productivity and order accuracy.
  • Inventory accuracy and cycle count variance.
  • Space utilization and storage capacity.
  • Shrinkage, damage, and expiry indicators.
  • Defining KPI formulas, data sources, and reporting boundaries.
  • Interpreting trends while balancing speed, accuracy, and service.
      Module 10: Supervising and Auditing Warehouse Processes  
  • Process mapping and identification of critical control points.
  • Reviewing procedures against actual warehouse practices.
  • Tracing transactions from documents to systems and physical stock.
  • Reviewing approvals, access rights, and segregation of duties.
  • Identifying control gaps and recurring process exceptions.
  • Documenting findings with clear supporting evidence.
  • Prioritizing corrective actions and tracking closure.
  Module 11: Warehouse Improvement Planning  
  • Identifying bottlenecks, unnecessary movement, and rework.
  • Improving layout, slotting, and picking arrangements.
  • Addressing inventory discrepancy root causes.
  • Standardizing transaction recording and exception handling.
  • Assigning improvement owners and measurable targets.
  • Monitoring results and sustaining operational improvements.
  Module 12: Capstone — Warehouse Operations and Inventory Improvement Plan  
  • Review a warehouse scenario containing layout, transaction, inventory, and performance information.
  • Identify weaknesses across receiving, put-away, storage, picking, and dispatch.
  • Recommend appropriate FIFO or FEFO controls.
  • Develop a cycle counting and inventory reconciliation plan.
  • Propose controls to reduce shrinkage and improve traceability.
  • Select relevant KPIs and define their calculation and reporting requirements.
  • Produce a prioritized improvement plan with responsibilities and expected outcomes.
 

This course develops the foundational knowledge and practical skills needed to configure, administer, and maintain the ServiceNow platform. Participants explore platform navigation, instance configuration, application collaboration, self-service, automation, database management, security, and configuration migration. The proposed five-day duration accommodates foundational learning, configuration activities, and an integrated capstone. Duration 5 Days – 35 hrs.   Objectives...

Duration: 5 days – 35 hrs   Overview The “SOC Network and Threat Detection and Analysis” training course is designed to equip Security Operations Center (SOC) analysts and IT security professionals with the skills and knowledge required to detect, analyze, and respond to network threats effectively. This comprehensive course covers essential topics such as threat...

Duration 1 day – 7 hrs   Overview   This 1-day training builds upon basic warehouse operations knowledge and introduces key logistics concepts involved in the movement and coordination of goods—especially wet and dry food items—within and outside the warehouse. Participants will explore transport logistics, inbound and outbound coordination, documentation practices, and cold chain considerations,...

Duration 2 days – 14 hrs   Overview   This hands-on course provides an introduction to Splunk, a powerful platform for searching, monitoring, and analyzing machine-generated data. The training focuses on how developers and QA professionals can leverage Splunk to gain insights from logs and metrics, improve application observability, detect anomalies, and support test validation....

Duration 3 days – 21 hrs   Overview.   This course is designed for fresh graduates aspiring to build a career in Data Science. It introduces the fundamentals of data science, focusing on data analysis, visualization, and basic machine learning concepts using Python. The course provides hands-on practice with real-world datasets, equipping participants with the...

// BG EARTH WHEN NOT PLAYING

We use cookies on our website to personalize your experience by storing your preferences and recognizing repeat visits. By clicking “Accept”, you agree to the use of all cookies. You can also select “Cookie Settings” to adjust your preferences and provide more specific consent. Cookie Policy