Data Ingestion Bounds
Overview
By default, Vital:
-
pulls historical data as far back as indicated by the pull preferences you specified (if any), or the default historical pull range.
-
accepts all new and changed data discovered through polling, incoming provider webhooks and Vital Mobile SDK integrations.
If you need to impose a date bounds on the data being collected, you can set data ingestion bounds on a per-user basis:
-
The data ingestion bounds restricts the historical pull range of any new connections of the user.
-
The data ingestion bounds restricts data ingestion from any connections of the user — out of bound data are dropped.
-
When the user ingestion end date is reached, a 7-day late delivery catchment period starts. Once the catchment period expires, all connections of the user are automatically de-registered and marked as paused.
Because dates are in floating time, you should expect an error margin of ±1 days on ingestion bound enforcement. If you cannot tolerate an error margin, offset the user data ingestion bounds you set accordingly.
Setting Ingestion Start and End Dates
You can specify the user data ingestion bounds (ingestion_start
and ingestion_end
) when you:
Changing Ingestion Bounds
You can change the ingestion bounds at any time.
However, do note that it has no retrospective effect on data already ingested — Vital does not delete collected data in response to ingestion bound changes.
As long as the connection has not been marked as paused, you can change the ingestion end date to extend the ingestion bounds at any time, even during the (post ingestion end) 7-day late delivery catchment period.
Otherwise, the ingestion end date has no effect on any paused cloud-based connections — since these connections have been deregistered with the data provider, the end user needs to go through the Vital Link flow to re-connect.