general FAQs

Instead of offering standalone proxy lists, our API and Crawler products are integrated with thousands of residential and datacenter proxies from around the world, enhanced by artificial intelligence and our expert engineering team, to deliver the best possible data results. If you're only interested in proxies without the additional benefits, we suggest using Smart Proxy as an alternative.

We do not disclose the exact number of proxies, as it is constantly changing. Our network experts continuously source new worldwide proxies and replace faulty ones, while our AI adjusts the proxy set size depending on the target website. If you are a proxy provider or have proxies to sell contact us to help expand our infrastructure.

We strive to support all websites effectively. If you experience blocks or captchas, please contact us so we can assist and find a solution for your specific situation.

We do not store any credit card information. Instead, all payment data is directly and securely stored with our payment partner, Paddle, which adheres to global payment regulations to ensure your information remains safe.

To add your VAT details, please go to the Settings and Billing page. When entering your card information, select your country, and then click the VAT number button located in the bottom left corner of the window. Enter your VAT details there. If you have already provided your card information, you can simply re-enter it to add the VAT number.

To change the billing email address, first, go to the Account page and initiate the process of reauthorizing your billing details. When the billing details form appears, you'll see your current email address in the bottom right corner next to a "Not you?" button. Click this button and enter the desired email address for billing. Finally, complete the payment reauthorization process to save the updated billing email.

Yes, you can change your account email address. To do so, visit the Account page and look for the "Change email address" option. After updating your email address, you will receive a confirmation email at the new address. Please confirm the change by following the instructions in the email.

Crawlbase doesn't support any illegal activities. Any account being used for illegal purposes will be automatically suspended and no money will be refunded. If you want to know if the data you are storing or the processes you do with such data are legal in your country, please consult with the appropriate person in your country of business operations as we cannot provide legal advice on each individual use case.

there is no limit. The crawler will send back the full html of the page regardless of its size

When you utilize our API to send requests, we employ a comprehensive approach to safeguard your IP address and ensure anonymity during the crawling process. Our API leverages a pool of millions of proxies, enabling us to avoid blocks and CAPTCHAs while effectively masking your IP with each request. This process ensures that your requests remain anonymous and untraceable by the websites you're crawling.
 

It's essential to highlight that we never engage in IP forwarding, as such practices are not feasible within our API-based crawling system. Rest assured, your IP remains protected and inaccessible to external parties throughout the entire crawling process. Your privacy and security are of utmost importance to us.

 

For more complex websites like G2.com, we can implement a custom solution utilizing trained AI bots, which further enhances our ability to avoid proxy failures and blocks. By utilizing premium residential networks within the US, we distinguish legitimate requests from automated bots effectively, ensuring a smooth and uninterrupted crawling experience. Contact our support team for more details.