Grow is continually adding data to the data warehouse. As we add new tables of data to existing data sources, or adding new data sources entirely, we want to ensure the best experience possible. To do this, we added a simple status icon to help you know what to expect when working with specific tables of data in the warehouse.
The process for adding data to the warehouse requires constant iterative development. As we progress through each development stage, you can expect the reliability, performance, and experience to progressively improve.
Below is a brief description for what you can expect when working with data in each of the following release stages and where to see the status for each of these tables of data.
What does each status mean?
Coming Soon
This is the earliest stage in our release process. Data in this stage can only be warehoused by requesting it through our support team.
Data Structures: Data is available in its most raw format as it comes back from the API. Data structures and formats will be changing as more testing is completed so any metrics/datasets created from this data should be expected to need modification as changes roll out.
Error Handling: There is no error handling at this stage.
Data Refreshing: Refreshing is not yet optimized.
Alpha
For data in this stage, you can expect the following:
Data Structures: Data is broken out into more organized tables; however, these tables may see frequent changes. You may see changes to column names, data types, adding/removing columns, data formatting, etc.
Error Handling: There is some error handling at this stage to make the data more reliable.
Data Refreshing: Refreshing is not yet optimized.
Beta
For data in this stage, you can expect the following:
Data Structures: Derived table schemas are mostly stable at this point; however, minor changes may still occur at this stage.
Error Handling: There is more error handling at this stage making the data more reliable. Additionally, there is some basic error messaging making it clearer what the issue may be (e.g., Permission-related restrictions to data).
Data Refreshing: Refreshing has some improved resume logic built in.
General Release
There is no icon to indicate when data is in this stage, but rather an absence of any icons. What you can expect for data in this stage is the following:
Data Structures: Derived table schemas are very stable at this point; however, there may be rare edge cases that require adjusting the schemas. We will work with any customers to communicate what implications, if any, there may be to your metrics and datasets if we must update table schemas if changes are necessary.
Error Handling: There is much more robust error handling and messaging at this stage making the data fairly reliable. However, due too the ever-changing nature of APIs, errors and upgrades may cause rare, but temporary outages in data source connectivity.
Data Refreshing: Where possible, refresh rates have been optimized to pull data more quickly, using fewer API resources. This allows more frequent refresh intervals, so you can have more data up-to-date more often.
Where can I see the status?
Connection Toggle Page
You can see the status of the Source Table data by clicking the Manage Connection button for a specific data source.
Data Settings in the Metric and Dataset Builders
You can see the status of Warehouse tables (including Derived Tables) in the Data Settings section, the first step in the transform Pipeline, in the Warehouse Table Selection Drop-down.