Crawl the websites you list and collect the email addresses and phone numbers on them.
Website Crawler takes a list of websites, walks their pages and collects the contact details it finds. ## Setting it up - **Root domains** — one per row, at least one. Paste a whole list (new lines, commas or semicolons) and it fills a row per domain. You can give a single domain its own delay. - **Phone number country** — which country bare local numbers belong to, so the same number is not stored twice. - **Crawl order** — as added (default), random, A→Z or Z→A. You can also override it when you start the crawl. - **What to collect** — email addresses and phone numbers, both on by default. - **Depth and scope** — home page only, or a deep crawl with a **depth limit** (3 by default) and a **maximum pages per site** (500 by default, up to 20,000). - **Use sitemap.xml** — on by default and recommended: it is the fastest way to find a site's pages. - **Follow external links** — off by default. On, the crawl leaves the domain. - **Render JavaScript** — off by default; switch it on for sites that build their content in the browser. It is slower. - **Save results to the Contact Database automatically** — off by default. - **Delay between pages** — 2 seconds by default. Being polite keeps us welcome on other people's servers. ## Starting and following it Press **Start crawl (N)** for every waiting site, or pick sites and crawl only those. Each site then shows its own status: waiting, running, completed, failed or skipped — with the reason written next to it, such as "domain is on the blocked list" or "stopped before this site was reached". When the run ends, the owner gets an email with the pages crawled and how many contacts were found. ## What it costs A fixed price **per website**, charged when you press Start. Nothing more is taken during the crawl, and running out of credit cannot interrupt a crawl that has already started. Sites that gave you nothing are refunded automatically: the ones the run never reached, and the ones it tried where not a single page answered — a dead domain, an address that no longer exists, a site that refuses automated visits. You will see a "Refund: N site(s) with nothing collected" line in your credit history. ## The results Two tabs: **Extracted contacts** (filter by type, search by value or page, save into the Contact Database, delete) and **Crawled domains** (completed, failed, skipped or waiting, with pages and contacts per domain). A "Recent runs" table lets you look at one run at a time. Deleting a contact also puts it on your **Removed** list, so later crawls do not collect it again. There is a Deleted view with Restore if you change your mind. Exports: Excel (separate sheets for emails, phones and a summary), CSV, TXT (bare value lists) and JSON. ## Worth knowing - Only pages that answer normally count as crawled, so a dead site shows zero pages and lands in Failed. - Phone detection is deliberately careful with free text — a number needs enough digits to be a real one, which keeps dates and order numbers out of your data. - Addresses written as "office [at] example [dot] com" are decoded. - A Website Crawler campaign created by a Lead Generator belongs to it: you start its crawls from the Lead Generator page.