Data collection pipelines
Scrapers and scheduled jobs that pull data, clean it, and drop it where the product can use it.
A walkthrough of how this kind of system works. Not the production app.
FetchParseStoreAlert
| Source | Title | Price | Status |
|---|---|---|---|
| store-a.com/p/1 | Blue chair | $120 | ok |
| store-a.com/p/2 | Oak desk | $340 | ok |
| store-b.com/p/9 | Lamp | — | skipped |