Jedox Integrator: First Steps

image_pdfimage_print

Introduction

Jedox Integrator is Jedox’s Extract, Transform, and Load software. This module is designed specifically to tackle the considerable challenges of importing and exporting large quantities of data from Jedox databases. It allows the extraction of data from heterogeneous sources, as well as the transformation and loading of master and transaction data into Jedox models. With the help of the Jedox Integrator, flexible data imports can be carried out easily and fully automatically. All established relational databases can be connected as data sources via a standardized interface. Furthermore, complex transformations and aggregations can be modeled.

Jedox ETL is a client-server based application, which means that the modeling of ETL processes takes place in a user-friendly web interface. Furthermore, the ETL tool can also be easily integrated into other applications with the SOAP-based (Simple Object Access Protocol) web service interface.

Jedox Integrator can be operated both from the command-line level and, more conveniently, using the web-based component Integrator of Jedox Web.

If you have carried out a Jedox Integrator update installation, clear your browser’s cache and your cookies to ensure that you are working with the most up-to-date Integrator.

Creating a new Jedox Integrator Project

At the start of a new Integration process, a new project must be created. Alternatively, you can use an existing example or you can import a provided sample project.

When you open the Integrator component, you will see the Integrator task buttons and the existing examples:

Task buttons (from left to right):

New Project

Save all changes

Refresh

Monitor: displays an overview of the performed jobs and loads, as well as detailed information about individual projects.

Import: imports Integrator projects.

Collapse: collapses all opened substructures in the Jedox Integrator projects list.

Sort by type: if set, then components are grouped by type and then by connection type (left picture below). If not set, then the components are not grouped by type (right picture below).

Grouped by type:

Not grouped by type:

Create a new project and name it “Test1”. It is created initially with an empty module structure.

Click on Test1 in the project list. Now you can enter a description of the project in the right window: Click on the Save button in the toolbar when you have completed your description.

Creating a new component

By right-clicking on a module you can create a new corresponding element, or you can display an overview of the elements that exist in the selected component group. In the screenshot on the right you can see the possibilities.

As an example, we will create a new connection.

In next step you can select the connection type and give it a name. Select “CSV File” and click OK.

 

At the next screen, you can enter a description and make selections for main settings and advanced settings.

 

Right-clicking on a component group (Variables, Connections, Extracts…) under the project name, you can see an overview of the elements:Here you can sort the elements by name, type, and description. Furthermore, you can resize this window and all displayed columns.

Double-clicking a component opens this component and closes the overview window.

Flow Graph

Jedox Integrator projects can become complex if a lot of data sources, extracts, and transformations are necessary. A FlowGraph can help to give you a better overview of the whole Jedox Integrator process flow. It displays all preceding and all following components for the focused component.

To generate a FlowGraph, click on the Layout button in the component Integrator (see screenshot below). Here you have several options for displaying your FlowGraph within the component Integrator.

Note: The FlowGraph is only displayed in recent browser versions, e.g. in Firefox 10 or higher or Internet Explorer 10 or higher.

Navigation in Jedox Integrator

The Jedox Integrator makes it very easy to navigate step-by-step through an Integrator project. To show how this works, we will refer to the demo project “sampleBiker”. Navigate to the connection called “CustomerRegions_file”, using the screenshot below as a guide. Click on the “Layout” button and select “FlowGraph Right” from the drop-downlist of “Layout”.

You can click on each element of the modules “Connections”, “Extracts”, etc. in the tree on the left side to change your view, or you can select an element in the FlowGraph on the right side to go to that step.

Testing a Component

Each component of a Jedox Integrator project can be tested individually. To do so, select a connection in the tree on the left side and click Test.

Preview Data of an Extract

For each Extract or Transform, the first lines of data can be displayed to check the accuracy of the data during the Modeling. Click on the FlowGraph component “Extract: File: CustomerRegions” in the sampleBiker project and click the Data Preview button.

Executing a Job

The final stage of the execution of a Jedox Integrator process is carried out via a Job. To see a demonstration of an Integrator process, navigate to “Jobs – Standard – Cubedata” in “sampleBiker” (refer to the screenshot below). The following screen will appear:

Click Run. The result appears in the Monitor tab, as shown below.

This job shows an error, because it requires execution of the Initdata and Masterdata jobs to create the necessary dimensions.

Stopping the Execution of a Job

To stop the execution of a running job (Status “Running”) click on the Stop button (which is no longer active in the screenshot above) in the Integrator’s Monitor. Jedox Integrator will then try to terminate the execution of this job. After termination, the status is set to “Interrupted”.

Note: in some cases, stopping an execution may take a longer time (e.g. if a long-running request has been send to a source or target system). In this case, the status “Stopping” is displayed in the monitor. By clicking the Stop button a second time, an interrupt signal is sent to the thread of this execution. In most cases the execution will then be interrupted.

Scheduling a Job

With the availability of the Scheduler component, Integrator jobs can be scheduled directly in Jedox Web without the use of a third-party tool. Select a job on the job overview page and then click the Schedule button:

The Task Wizard appears:

All previously settings can be changed later using the Scheduler component.

Jedox Integrator sample projects

A good way to get familiar with the Jedox Integrator functionality is to try out the sample projects. After the software installation, you will find two sample projects in the Integrator:

  • sampleBiker project: this project is helpful for getting a first impression of how to use Jedox Integrator for loading data to an OLAP database.
  • ETLTasks project: this is a rather complex project that includes jobs for some often-recurring general tasks, like DatabaseCopy, CubeAnonymize, etc.

Furthermore, there are other instructive samples that you can manually import into Jedox Integrator with the Import button. These sample projects can be found in <Install_path>\tomcat\webapps\etlserver\data\samples.

image_pdfimage_print
Was this post helpful?
NoYes (-2 rating, 12 votes)
Loading...