Instant Pentaho Data Integration Kitchen

Explore the world of Pentaho Data Integration command-line tools which will help you use the Kitchen

Overview

• Learn something new in an Instant! A short, fast, focused guide delivering immediate results
• Understand how to discover the repository structure using the command line scripts
• Learn to configure the log properly and how to gather the information that helps you investigate any kind of problem
• Explore all the possible ways to start jobs and learn transformations without any difficulty

In Detail

Pentaho PDI is a modern, powerful, and easy-to-use ETL system that lets you develop ETL processes with simplicity. Explore and gain the experience and skills that you need to run processes from the command line or schedule them by using an extensive description and a good set of samples.

Instant Pentaho Data Integration Kitchen How-to will help you to understand the correct way to deal with PDI command line tools. We start with a recipe about how to configure your memory requirements to run your processes effectively and then move forward with a set of recipes that show you the different ways to start PDI processes.

We start with a recap about how transformations and jobs are designed using spoon and then move forward to configure memory requirements to properly run your processes from the command line.

We dive into the various flags that control the logging system by specifying the logging output and the log verbosity. We focus and deliver all the knowledge you require to run the ETL processes using command line tools with ease and in a proficient manner.

What you will learn from this book

• Understand how to configure memory requirements
• Discover the PDI repository structure from the command line
• Explore how to start jobs from a filesystem packed in an archive file
• Schedule PDI processes on Linux and Windows
• Master the art of configuring log levels and logging output
• Start jobs from the repository
• Get feedback from your process execution

Approach

Filled with practical, step-by-step instructions and clear explanations for the most important and useful tasks. A practical guide with easy-to-follow recipes helping developers to quickly and effectively collect data from disparate sources such as databases, files, and applications, and turn the data into a unified format that is accessible and relevant to end users.

Who this book is written for

Any IT professional working on PDI and is a valid support for either learning how to use the command line tools efficiently or for going deeper on some aspects of the command line tools to help you work better.

Sergio Ramazzina

Sergio Ramazzina is an software architect/trainer with more than 20 years of experience on a broad number of projects for banks and major Italian companies, designing complex enterprise solutions in Java/JavaEE and Ruby. He started using Pentaho products from the very beginning in (late 2003), gaining deep experience by deploying Pentaho as an open source BI solution, standalone, or deeply integrated in other applications that he had designed as the analytics engine of choice. Starting from 2009, based on his experience in the Java/JavaEE world and because of the appreciation for the open source world and its main ideas, he began participating actively as a contributor to some of the Pentaho projects: JPivot, Saiku, CDF, and CDA, and gained the Pentaho Active Contributor level. In late 2010, he founded Serasoft, a young Italian consulting company specialized in the design and delivery of open source Business Intelligence solutions and started participating as a BI architect and Pentaho expert on a wide number of projects where the open source BI and Pentaho are the main actors. He is also covering the role of CTO for Athilab (Athirat Innovation Lab), sharing his experience in the design and delivery of high value innovative enterprise solutions. He is always looking for innovative solutions that can help users work more efficiently. He is also passionate about skiing, tennis, and photography.