Introduction
With Webhooks and ETL Pipelines, Vital pushes any new data or updates to your endpoint or your ETL destination as soon as they are discovered.
Connection Created stage
When a user successfully connects a provider through Vital Link, Vital sends a Provider Connection Created event to acknowledge it:
Historical Data Backfill stage
Vital also schedules jobs to backfill historical data upon connection establishment.
Historical data are data that exist prior to the connection establishment. Because this can amount to months of data — and might potentially run into temporary provider-side API rate limits — these backfill jobs may take minutes to hours to complete.
You can inspect the status of historical data backfill jobs of each individual user through Vital Dashboard or Vital API.
Once the historical data backfill job of a specific resource has fully completed, Vital sends a Historical Pull Completion event for the resource:
ETL Pipelines can opt-in to receive historical data as Vital Data Events (as outlined below in the Incremental Data stage section).
Note that Vital would still send the Historical Pull Completion event to signal the completion of the historical data backfill stage.
Incremental Data stage
Once the historical data backfill stage completes, Vital monitors for new data and changes.
Whenever new data or changes are discovered, Vital sends them out as Data Events as soon as possible:
You can inspect the state of incremental data updates of each individual user through Vital Dashboard or Vital API.