Crawling API to easily scrape the web

Protect your web crawler against blocked requests, proxy failure, IP leak, browser crash and CAPTCHAs!

Built by scraping experts, Crawling API is used in crawlers of fortune companies.
Try it free. No credit card required. Instant set-up. Contact us if you need more information.

curl -X GET -G https://api.proxycrawl.com \

--data token=PRIVATE_TOKEN `# Required. Your API access token.` \
--data url=https://proxycrawl.com/ip `# Required. A URL to crawl.` \
--data country=US `# Proxy location country, +48 countries.` \
--data scraper=scraper-name `# Crawl then extract with a scraper.` \
--data screenshot=true `# Take screenshots of browser as images.` \
--data format=html `# API response format, accepts JSON.` \
--data store=true `# Store your crawled or scraped data in the cloud.` \
--data device=mobile `# Crawl on mobile devices or desktop.` \
--data autoparse=true `# Crawling API can autoparse any web page.` \
--data tor_network=true `# Crawl any onion website over the Tor network.` \
--data user_agent=AGENT `# Crawl with the given User Agent.` \
--data ajax_wait=true `# Headless browser can wait for slow ajax.` \
--data page_wait=5000 `# Instruct the API to wait longer.` \
--data css_click_selector=.css-class `# API can click selectors.` \
--data proxy_session=value `# Same Proxy across several requests.` \
--data cookies_session=value `# Pass cookies to next requests.` \
--data get_headers=true `# Return headers from original website.` \
--data get_cookies=true `# Return cookie from original page.` \
Cloud servers

Start crawling in minutes

Easily integrate crawling in your apps.

Forget about hardware, infrastructure, proxies, setup, blocks, captchas…

We handle all that for you. Just call our API and get website data.

We literally support millions of different websites.

  • github.com
  • cnn.com
  • fc2.com
  • dropbox.com
  • pixnet.net
  • amazon.de
  • blogger.com
  • alibaba.com
  • wikia.com
  • twitch.tv
  • producthunt.com
  • amazon.in
  • so.com
  • nytimes.com
  • ask.com
  • bbc.com
  • 360.com
  • savefrom.net
  • craigslist.org
  • haosou.com
  • whatsapp.com
  • amazon.co.uk
  • bbc.co.uk
  • vice.com
  • tribunnews.com
  • stackexchange.com
  • rakuten.co.jp

Crawl regular and javascript dynamically generated pages

With our API, you can crawl using real web browsers.

So even if the page is built using only javascript; React, Angular, Vue, Ember, Meteor, etc, we can crawl it, and provide you the HTML so you can easily scrape it.

Javascript scraping and crawling
Cloud scraping servers

We avoid blocks and captchas for you

Thanks to our knowledge, artificial intelligence and our team of engineers, we constantly tweak and change our algorithms to avoid blocks and solve captchas for you.

We care for your crawling success.

Captcha solver

Capture and save screenshots

Capture screenshots

Keep track of the visual changes on all pages you crawl with an easy to use Screenshot API feature.

Get screenshots of the entire crawled pages in JPEG format, we'll save each of them in our system for up to an hour.

Easy to use API with instant setup

Start crawling websites in minutes thanks to the easy to use API built from developers to developers.

Simple integration with your favorite language and framework.

Create a free account

Scraping API
Cloud servers
Start for free and scale when you need it
Simple pricing

For small and big projects without hidden fees

No long-term contracts

Pause at any time and come back later when you need to crawl again

Only pay for success

You will only pay for successful requests

Free start

First 1,000 requests are completely free

Create a free account

Monthly pricing calculator
How many pages do you plan to crawl each month?
Input your estimated number
Successful RequestsPrice per requestTotal price
0 - 1,0000.3¢$0.00
Next 10,0000.2¢
Next 100,0000.06¢
Next 1,000,0000.05¢
Next 10,000,0000.01¢
Next 100,000,0000.005¢
Next 1,000,000,0000.004¢
After 1,000,000,0000.002¢
Input your estimated number
Successful RequestsPrice per requestTotal price
0 - 1,0000.6¢$0.00
Next 10,0000.4¢
Next 100,0000.12¢
Next 1,000,0000.1¢
Next 10,000,0000.02¢
Next 100,000,0000.01¢
Next 1,000,000,0000.008¢
After 1,000,000,0000.004¢
Regular pages
$0.00
Javascript pages
$0.00
Total cost:
$0.00
Taxes may apply for EU residentsYou only pay for successful requests
Supporting all kind of projects

Used by the world’s most innovative businesses – big and small;

  • Shopify scraping
  • Expedia scraping
  • H&M scraping
  • Pinterest scraping
  • Zurich scraping
  • Nike scraping
  • Yahoo scraping
  • University scraping
  • Interactive brokers Scraping
  • Oracle scraping
  • Samsung scraping
  • Standford scraping

Trusted by more than 16,000 paying customers

Which crawled 334,168,386,906 unique pages anonymously

Start crawling and scraping the web today
Try it free. No credit card required. Instant set-up.