Data Transform Pipeline

Using Tranforms

Adding a Transform

To add a transform, simply click Add Transform. This will bring up the list of transforms. You can add whatever transform you need, and an icon for that transform will appear under the Data Settings as the second step in the pipeline.

add-transform-button.png

Removing a Transform

To remove a transform, click on the transform. Within that transform in the lower right, click the Remove button. Or hover over the transform icon, click on the three-dot menu button, and select Remove transform.

remove-transform.gif

Reordering Transforms

To rearrange the transform order, hover over the transform you want to move. Two dotted lines will appear on the left side of the transform box. Click and drag the two dotted lines to move the transform to whatever order you want. But be careful if you move transforms into a different order, you could break the logic that your data is relying on.

reorder-transforms.gif

Viewing the Data at Each Step

As you click on each transform, the table area at the bottom right will update to show the data up to that point in the pipeline, ignoring any transforms after it. This is a handy way to check what data was available before running a group or pivot table transform, for instance.

Best Practices

Here are some tips and best practices with using the new transform pipeline:

The filter transform has the operatorsANDandOR. When using the filter transform, all of the settings on the filter and in each filter group will either be AND or OR. You can mix and match AND and OR logic within one filter transform using different filter groups.

Let us say you wanted to look only at direct traffic and traffic from a specific source such as "Capterra" over the last week. To filter down to these results you could use 1 filter transform with 2 filter groups: the first filter group would be Source = "direct" OR Source = "Capterra". The second filter group would be Date = "last 7 days", and they would be filtered together with an AND.

Screen_Shot_2021-10-26_at_10.25.30_AM.png

Moving a transform may break the logic after it. If you move a transform that created a column based on a column of another transform, the logic will break. Let us say you create an aggregation that was based on a calculated column. If you move the aggregation before the calculated column, the aggregation will show up red, because it does not work to aggregate a column that does not exist in the logic. You have to change the configurations to make sure the logic makes sense.

Add aggregations after filters. If you plan on using filters and aggregations, the logical (not required, but logical) flow is to do aggregations last. This allows you to still see everything that you have set up with filters.

Disabled Add Transforms button? If you have columns with a duplicate title, the Add Transforms button will be grayed out and unusable. Be sure your data is formatted correctly, which includes unique column headers.

The logic between each transform defaults to AND logic.

Was this article helpful?