ProxyCrawl Cloud Storage
Easily store and search your crawled or scraped data.
Store. Search. Scale
Are you using Amazon AWS S3 or SQS to temporarily or permanently store your crawled pages?
Do you maintain your own database? Searching your crawled data is becoming a problem the more you scale up your web scraping requests?
ProxyCrawl Storage is a cloud scalable storage solution where you can permanently or temporarily store your HTML pages, screenshots and scraped data.
Storage handles scaling, backing up and cleaning of your cloud space so you can focus on what really matters for your business.
Cloud storage on demand
Start saving results in ProxyCrawl Storage and store up to 10,000 documents per month for free
Easy to use API
Built by developers, for developers.
Use the Storage API to retrieve saved pages and screenshots and do full-text search on the pages you are crawling.
Scrape and crawl
We provide tools to scrape and crawl any website while being anonymous and bypass any restriction, blocks or captchas.
If you need a custom solution or an expert advice on web scraping, our team of engineers are ready to handle every challenge.
Simply add "&store=true" to your Crawling API or Crawler calls and the data will be securely stored for you.
Storage is designed to solve the problem that you have data to store and you have no reliable or cost efficient solution to scale it.Create a free account
Supporting all kind of projects
Used by the world’s most innovative businesses – big and small