What happens between pressing Run and getting results — and what the statuses mean.
Every crawl is put in a queue and picked up by our servers. You can close the browser at any point; the work carries on. ## What the statuses mean | Status | What it means | |---|---| | **Queued** | Waiting its turn. | | **Running** | Our servers are working on it right now. | | **Success** | Finished. At least one site or listing was done. | | **Failed** | Everything it tried failed. Nothing is charged for a failed run. | A run can go back to **Queued** — it keeps its place — if it needs a website another run is crawling, or if our servers restarted. That is normal and costs nothing extra. ## Why your run may be waiting - **One crawl per website at a time, across the whole platform.** If another run (yours or someone else's) is on that domain, yours waits for it. This protects the sites we visit and keeps us welcome there. - **A limit per account** on how many crawls you run at the same time. Further runs keep their place in the queue without blocking anyone. - **A limit on the platform** on how many crawls run at once. The **Crawl Queue** page shows everything waiting and running for your account. You can drag your own waiting runs into a different order (they only trade places with each other), cancel a single domain, or stop everything. ## Watchdogs - A site that has not produced a new page for 5 minutes is left and the run moves to the next one. - No single site may hold a run for more than an hour. - A run that goes silent for 15 minutes is ended and marked failed. In each case the reason is written on the site's row, so you can see what happened. ## Stopping **Stop** ends a run immediately. Everything already collected is kept. Sites that were never reached go back to waiting, and what you paid for them is refunded.