This transform is used for cursor-based pagination, whereby a cursor or a token represents a specific position or record within the data set. It is commonly used to retrieve large sets of data in smaller, manageable chunks.
When setting up the transform, a variable must be configured for the cursor in the source data. The cursor is used to determine the position of the next set of records and returns the next page, along with a new cursor representing the position of the last record in the current page. This process continues until the cursor value returned from the source is blank (no value or null), indicating that all the data has been retrieved.
| Data source | An extract or transform in the current project. |
| Tree format | See Overview of Tree Formats |
| Remove columns with variable assignment | Removes the input column(s) used in the variable assignment from the output. |
| Maximum number of pages | Stops iteration at the number of pages set here. |
| Page size | Stops iteration if the number of rows returned is less than the number set here. |
Updated July 21, 2025