This is not the end, you can read more about all the features CrawlBoard has to offer in the datasheet.
CrawlBoard
CrawlBoard is the new version of our requirement gathering dashboard. It comes with many added features which makes your work easier, quicker & provides a superior user experience.
- Start a project or add new sites with just one click. Reporting issues made easier with all new ticketing system01.
- Get site specific graphs, visualizations, next set of crawl & other important details02.
- Quick invoicing & payment, as both are now integrated with CrawlBoard03.
- Improved UI makes it very easy to use and allows users to access its full potential04.
02.
. A quick walk-through
of CrawlBoard!
What our clients say
CrawlBoard has made our life much easier now. Integrating everything at one place has really made it the one stop solution for all the data needs, especially the new set of details & information provided for each site & set of crawls. PromptCloud has taken customer satisfaction to another level by understanding the needs and providing a packaged solution for them.
VP of Product, at eCommerce marketplace
part of early access program
02.
. Experience it yourself
Frequently Asked Questions
Q. What is the maximum frequency you can crawl data at?
Frequency would depend on your specific requirements. We can extract the data at a frequency ranging from a few minutes to once in a month.
Q. Can we get contextual information from the web page?
It would depend from site to site. However, we should generally be able to provide you with the preceding URL from where we discovered the final page URL.
Q. How do you maintain your code in order to deal with website structural changes?
While setting up crawlers, we setup automated check points to monitor structural changes. In case a site changes its structure, we would be notified and shall fix them accordingly.
Q. How do we access data on our side?
The data can be delivered in XML, JSON or CSV format. The default mechanism for delivering data is via our RESTful API. We can also push the data to one of your file sharing servers (FTP, SFTP, Amazon S3, Dropbox, Gdrive, Box or MS Azure). If you’re not very technically inclined, you can simply use the one-click data download option on CrawlBoard.
Q. Do you have an IP rotation service?
Yes, our platform, by default, handles IP rotation and mechanism to handle other common blocking issues.
Q. What kind of infrastructure do you offer?
As a client, you’d have access to our portal – CrawlBoard. This would be your centralized portal for technical support, billing and keeping a tab on the crawler activities and stats. You’d also be able to schedule ad-hoc crawls for the future. Error handling happens via our ticketing system.
03.
.