Crawling API to easily scrape the web
Protect your web crawler against blocked requests, proxy failure, IP leak, browser crash and CAPTCHAs!
curl -X GET -G https://api.proxycrawl.com \
Start crawling in minutes
Easily integrate crawling in your apps.
Forget about hardware, infrastructure, proxies, setup, blocks, captchas…
We handle all that for you. Just call our API and get website data.
We literally support millions of different websites.
- facebook.com
- baidu.com
- yahoo.com
- wikipedia.org
- youtube.com
- qq.com
- taobao.com
- amazon.com
- live.com
- vk.com
- twitter.com
- hao123.com
- instagram.com
- sohu.com
- sina.com.cn
- 360.cn
- stackoverflow.com
- netflix.com
- tripadvisor.com
- amazon.co.jp
- imgur.com
- imdb.com
- cnzz.com
- pinterest.com
- office.com
- indeed.com
- bitauto.com
- github.com
- cnn.com
- fc2.com
- dropbox.com
- pixnet.net
- amazon.de
- blogger.com
- alibaba.com
- wikia.com
- twitch.tv
- producthunt.com
- amazon.in
- so.com
- nytimes.com
- ask.com
- bbc.com
- 360.com
- savefrom.net
- craigslist.org
- haosou.com
- whatsapp.com
- amazon.co.uk
- bbc.co.uk
- vice.com
- tribunnews.com
- stackexchange.com
- rakuten.co.jp
- tmall.com
- weibo.com
- yandex.ru
- yahoo.co.jp
- reddit.com
- ebay.com
- bing.com
- aliexpress.com
- msn.com
- wordpress.com
- blogspot.com
- tumblr.com
- espn.com
- dailymotion.com
- zhihu.com
- ebay.de
- vimeo.com
- soundcloud.com
- ebay.co.uk
- booking.com
- quora.com
- dailymail.co.uk
- huffingtonpost.com
- theguardian.com
- google.com
- csdn.net
- cnet.com
- glassdoor.com
Crawl regular and javascript dynamically generated pages
With our API, you can crawl using real web browsers.
So even if the page is built using only javascript; React, Angular, Vue, Ember, Meteor, etc, we can crawl it, and provide you the HTML so you can easily scrape it.
We avoid blocks and captchas for you
Thanks to our knowledge, artificial intelligence and our team of engineers, we constantly tweak and change our algorithms to avoid blocks and solve captchas for you.
We care for your crawling success.
Capture and save screenshots
Keep track of the visual changes on all pages you crawl with an easy to use Screenshot API feature.
Get screenshots of the entire crawled pages in JPEG format, we'll save each of them in our system for up to an hour.
Easy to use API with instant setup
Start crawling websites in minutes thanks to the easy to use API built from developers to developers.
Simple integration with your favorite language and framework.
Start for free and scale when you need it
Simple pricing
For small and big projects without hidden fees
No long-term contracts
Pause at any time and come back later when you need to crawl again
Only pay for success
You will only pay for successful requests
Free start
First 1,000 requests are completely free
Monthly pricing calculator
How many pages do you plan to crawl each month?| Successful Requests | Price per request | Total price |
|---|---|---|
| 0 - 1,000 | 0.3¢ | $0.00 |
| Next 10,000 | 0.2¢ | |
| Next 100,000 | 0.06¢ | |
| Next 1,000,000 | 0.05¢ | |
| Next 10,000,000 | 0.01¢ | |
| Next 100,000,000 | 0.005¢ | |
| Next 1,000,000,000 | 0.004¢ | |
| After 1,000,000,000 | 0.002¢ |
| Successful Requests | Price per request | Total price |
|---|---|---|
| 0 - 1,000 | 0.6¢ | $0.00 |
| Next 10,000 | 0.4¢ | |
| Next 100,000 | 0.12¢ | |
| Next 1,000,000 | 0.1¢ | |
| Next 10,000,000 | 0.02¢ | |
| Next 100,000,000 | 0.01¢ | |
| Next 1,000,000,000 | 0.008¢ | |
| After 1,000,000,000 | 0.004¢ |
Supporting all kind of projects
Used by the world’s most innovative businesses – big and small;
Trusted by more than 16,000 paying customers
Which crawled 334,168,386,906 unique pages anonymously