Pentaho Data Integration Fundamentals

This training is guaranteed to take place

Pentaho Course -ID

DI1000

Duration:

3 days

Dates:

Course description

With data volumes growing all the time, companies need quick and easy ways to use their data and gain greater insights. The primary challenge is having a consistent, unified version of information across all sources in a form that is suitable for analysis. With Pentaho Data Integration, powerful (ETL) resources can be extracted, transformed and loaded. It is also possible to create an intuitive and professional graphical development environment and an open and standards-based architecture.

Pentaho Data Integration offers a comprehensive ETL solution

A powerful graphical process designer for ETL developers
Almost unlimited interfaces for integrating any type of data, including diverse and large amounts of data
High scalability and performance, including in-memory caching
Big Data integration, analysis and reporting (via Hadoop, NoSQL, traditional OLTP and analytical databases)
A modern, open and standards-based architecture
The course includes both presentations and hands-on exercises that cover theory, best practices, and design patterns.

Target Audience

This course is the third in the field of data analysis. It is aimed at participants who have already dealt with the development or administration of databases or who would like to get started with Pentaho Data Integration.

Business User	Business Analyst	Data Analyst	Software Architect	Pentaho Admin	Pentaho Support

Learning Goals

After completing this course, you will be able to:

install Pentaho Data Integration
create and execute basic transformations with steps and hops
display the mapping results in the metrics and log view
create database connections and use the data source via the Database Explorer
generated complex transformations by configuring the following steps: table input, table output, CSV file input, insert/update, add constants, filter, value mapper, stream lookup, add cells, merge cells, sort cells, row normaliser, JavaScript, dimension lookup/update, database lookup, extracting data from XML, setting environment variables and analytical queries
create transformations that use parameterised values
map the structure of an online transaction process database to the structure of an online analysis process database
load data and write it to different databases
use ETL templates to populate a data warehouse
create images that process slowly changing dimensions
create Pentaho Data Integration jobs that: show multiple images, use variables, contain sub-jobs, provide integrated error messages, load and edit multiple text files, convert files into Microsoft Excel format
configure logging for transformation steps and job entries and check logged data
configure transformation step troubleshooting
configure the Pentaho Enterprise Repository, including basic security
use the repository to: create folders, save transformations and jobs, lock, delete, revise and restore artefacts
execute a transformation in Pentaho Data Integration and plan and monitor this in the Pentaho Enterprise Console
create and delete an index with a transformation
create transformations, configure the steps for running on a cluster, run transformations on the cluster, review the results, and monitor the transformation

Course Schedule

Day 1

Module 1	Introduction to Pentaho Data Integration
Lesson	Goals
Lesson	What is Pentaho Data Integration (PDI)?

Module 2	Transformation basics
Lesson	Getting to know the PDI user interface
Lesson	Creating a transformation
Exercise	Generierung von Rows, Sequences und Select Values
Lesson	Error handling & introduction to logging
Lesson	Introduction to repositories

Module 3	Reading and writing files
Lesson	Input and output steps
Lesson	Parameters & Kettle.properties
Exercise	CSV input to multiple outputs using switch/case
Exercise	Create a serialisable file from several files
Exercise	Deserialise files

Day 2

Module 4	Working with databases
Lesson	Connect and explore databases
Lesson	Tables – Input and output
Exercise	Reading and writing database tables
Lesson	Steps using insert, update and delete
Lesson	Cleansing Data
Lesson	Using parameters & arguments in SQL Queries
Exercise	Input with Parametern / Table Wizard

Module 5	Data flows and lookups
Lesson	Copying and distributing data
Exercise	Working with parallel processing
Lesson	Lookups
Exercise	Lookups & data formatting
Lesson	Merging data

Day 3

Module 6	Calculations
Lesson	Using the "Group by" step
Lesson	Calculator
Exercise	Sorting, grouping and calculating order quantities
Lesson	Regular expressions
Lesson	User Defined Java Expression
Lesson	JavaScript

Module 7	Jobs Orchestration
Lesson	Introduction to Jobs
Exercise	Loading JVM data into a table
Lesson	Sending alerts
Lesson	Looping & conditions
Exercise	Creating a job with a loop
Lesson	Executing jobs from a terminal window (Kitchen)