Offer: Virgo is available for free to use within your infrastructure. Book a demo

Configure pull jobs

Not every source can push updates. For those without webhooks, Virgo runs scheduled pull jobs: it polls the source on an interval and ingests whatever changed since the last run.

How pulling stays incremental

Each pull asks the source for records changed since the last checkpoint, so a job moves only new and updated work through ingestion rather than reprocessing the whole source. The checkpoint advances after every successful run.

Choosing a schedule

Match the interval to how quickly a source changes and how fresh its data needs to be. Frequent polling keeps the graph current at the cost of more requests; a longer interval is fine for sources that change slowly.