Cube Load with Drillthrough

Definition of annex fields

The columns of the source that should be part of the detailed drillthrough data request (but not part of the cube) have to be defined. This can be done in the Dimension Mapping table by assigning the entry "" instead of a dimension name to the particular column. It is not necessary for these additional fields to be at the end of the source. The order of the columns in the source defines the display order.

Drillthrough modes

None

The default setting for cube load is None, which means drillthrough is disabled. To enable drillthrough, select one of the drillthrough modes described below.

Direct

No additional persistence of the detailed drillthrough data is done during the cube load. The requirement for this is that all detailed data can be retrieved via one relational extract without any further transforms. Only the link from the OLAP cube to this relational extract is stored in Jedox Integrator.

Relational extract (for direct drillthrough only): all detailed data can be retrieved through a relational extract during a drillthrough request. It may contain an arbitrary SQL SELECT statement (using a stored SQL procedure is not supported). The relational extract may have a field structure with a column mapping, but it must not contain default values for the columns.

Comments starting with /* are allowed, but not comments starting with -- (two hyphens).

A field structure should be defined in the corresponding relational extract (button "Refresh" in table "Field structure"). The column "Field name" may be filled or not. This increases the performance of the drillthrough request, especially in the case of complex SQL statements, as it omits an initial SQL query to the database to determine the output columns of the relational extract.

Persisted

During the cube load, the detailed drillthrough data, including the additional fields, is additionally persisted to a relational database. The link from the OLAP cube to this relational table is stored in Jedox Integrator.

Options for persisted drillthrough only:

Relational connection

A relational database connection where the detailed drillthrough data will be stored. They are recommended for very huge data volume. The same databases are supported as in relational load (e.g. Oracle or MS SQL Server) with the exception of MS Access. If no connection is specified, Postgres is used as the default relational connection.

For SQLite connections, schema should be left empty (error message will be raised if not), and a table name provided (the cube name will be used as table name if left empty). Since SQLite does not support schema, we recommend using either custom table names (could include the intended schema name, something like "SCHEMA_TABLE") or a different SQLite database for each OLAP database, since using cube names could result in conflicts from cubes in different databases having the same name.

Optional schema

The name of the schema in the relational database.
Default: the name of the OLAP database. This setting is not allowed for default relational connection Postgres.

Optional table

The name of the table in the relational database where drillthrough data will get stored. Default: the name of the OLAP cube. This setting is not allowed for default relational connection Postgres.

Persisted drillthrough is not possible with "Cube layout change mode" set to "addDimensions", "updateDimensions", or "reorderDimensions". Adding or removing a column to a cube that is loaded with drillthrough has to be done manually in the Modeler and the relational database table with an external database tool. This is only possible when using an external connection for the drillthrough. To add a column for the drillthrough data only (data that is not a dimension of the cube) changing the database table manually is sufficient.

Furthermore, additional columns to the relational table are only included with load mode "Create". With other load modes, they are ignored during the load and a warning is raised. As said above, these columns could be added manually to the relational table if an external relational database connection is used.

When deleting data, we recommend using a cube slice extract with mode "exclude" as source for the cube load, with mode "delete". This method makes the fewest possible requests to the relational database, resulting in optimal performance. For example, to delete all actual numbers of a certain year, a cube slice extract with mode "exclude" and "onlyBases" filters on Versions and Months dimensions should be the source of the cube load with persisted drillthrough.

When using relational DBs that do not support different schemas for the same database, the default name for a drillthrough table is set to the cube name. For this reason, if you use the same drillthrough connection for two OLAP databases that have cubes with the same name, the drillthrough data will be written in the same table. To prevent this in external drillthrough, use the "optional table" field and manually specify a unique name for the drillthrough table.

Differences between persisted and direct drillthrough

	Persisted	Direct
Data transformations	Allowed	Not allowed (only in SQL query)
Performance	Slightly higher query performance (if direct drillthrough with complex SQL query)	Higher loading performance, as no loading to relational persistence
Data accuracy	Consistent with cube data if the relevant cube slice is always loaded in a cube load with activated drillthrough (and the same connection, schema, and table).	Always up to date but potentially different from cube data. Consistency depends on the correct definition of the SQL query in the relational extract used for drillthrough.
Possible systems for source data	Any	One relational database system
Needed requirements	With external database: the Jedox Integrator project and the relational connection specified in the cube load must not be removed or renamed in order to find the correct data in a drillthrough request. With internal database: the Jedox Integrator project is not required.	The Jedox Integrator project and the relational extract specified in cube load must not be removed or renamed in order to find the correct data in a drillthrough request.

Notes and troubleshooting

If a dimension element is not found, by default, a warning is raised and the cube data will not be loaded, although the drillthrough data will be persisted. To avoid this, the option "Handling of missing elements" could be set to "createUnderDefault" or "createUnderDefaultParent".
The link of a cube to a drillthrough table can be displayed and removed in the Modeler.
The "splash" mode has to be set to "disabled" for all load modes, because no splashing can be done on the relational drillthrough data. This implies that only base elements can be handled in the source data.
It is not possible to run several cube loads with drillthrough for the same cube in parallel jobs.
Any manual changes to the cube slice relevant for drillthrough and to the cube layout will lead to inconsistencies in the drillthrough request. The same applies for manual changes to the relational table used in persisted drillthrough.
The cube load mode "insert" is not available in combination with drillthrough, as it might lead to inconsistencies between the cube and the detailed drillthrough data. Instead, the load mode "add" should be considered, possibly in combination with a preceding load mode "delete". For a cube load without drillthrough and a separate relational load for the drillthrough data (using relational load mode "insert" with "aggregation" option activated), it would be possible to achieve consistency but without linking the cube to the drillthrough table.
For a cell path for which no cell exists in the OLAP cube, no drillthrough values are displayed. The same applies to cell paths containing an element that the user does not have permission to see.
If the cube has HideElements set to true and a user does not have permission to see an aggregated element, the relationship between the element above and the elements below will break. For example, in an element hierarchy (consisting of the top level, the middle level, and the base element), if the user does not have permission to see the middle-level consolidation, neither the base element will be displayed below the top level, nor will the drillthrough data from the base element be displayed for the top level.
If rows with 0 or empty values are loaded in a Cube Load with persisted drillthrough and no cube cell is created in the cube, these rows will not be returned in a drillthrough request on this cube.
If using an external connection for persisted drillthrough, the cube load must be used to create the relational table, and the column type for columns that represent cube dimensions in the drillthrough table cannot be changed.

Postgres connections for persisted drillthrough

A dedicated PostgreSQL service is used as default persistence of drillthrough data. The standard limit for drillthrough data is 10GB; additional drillthrough data requires dedicated storage. If direct access (via Integrator) to the relational data is required, a Postgres connection must be established and defined in the options for persisted drillthrough. This is only possible with dedicated drillthrough storage, as credentials for the PostgresSQL service are not handed out as part of the limited drillthrough service with 10GB of storage. Contact your Jedox sales representative for pricing.

If a cube with drillthrough data is removed or renamed, the drillthrough data is no longer useful and will be deleted after 30 days.

The Postgres table name follows these patterns:

New tables: D_<Olap databasename prefix>#<Olap cubeame prefix>#<timestamp>
Migrated tables: M_<Olap databasename prefix>#<Olap cubeame prefix>

Updated August 20, 2024