New scrape
Extract structured data via adapter, or mirror a full site.
Web scraping engine
Extract structured data with purpose-built adapters, or mirror entire sites with the generic crawler. Ethical by default — respects robots.txt and throttles per-host.