Submit Your Requirement
Scroll down to discover

Archive

Q. Can you crawl sites that disallow bots?

April 13, 2020

No. We respect the robots.txt and crawl a site only if bots are allowed in robots.txt file.

Read more
01.

Q. Is crawling legal?

April 13, 2020

Yes. For a more convincing answer, read our blog post here.

Read more
02.

Q. Do you have an IP rotation service?

April 13, 2020

Yes, our platform, by default, handles IP rotation and mechanism to handle other common blocking issues.

Read more
03.

Q. What kind of infrastructure do you offer?

April 13, 2020

As a client, you’d have access to our portal – CrawlBoard. This would be your centralized portal for technical support, billing and keeping a tab on the crawler activities and stats. You’d also be able to schedule ad-hoc crawls for the future. Error handling happens via our ticketing system.

Read more
04.

Get The Latest Updates

© Promptcloud 2009-2020 / All rights reserved.
To top