Live Crawls
Get live data from websites via custom API using pre-defined input format


Access data from target pages in real-time
This solution is ideal when you don’t want to crawl all data from a source and store, but instead crawl live, as and when your user enters a search term on your site or app. This works similar to our site-specific crawl offering with the only difference that the desired frequency of crawl here is real-time.
The crawlers are setup in advance to extract information from your list of sources in your desired schema. We then provide you an API that you can hit with the search terms that your users expect data for, based on a predefined input format. Our platform then internally crawls the results, extracts data and returns structured data via the same API.
Example:
If you are a re-commerce store, selling used items on your site, you’d like the crawl to occur in real-time when your user searches your website using an EAN.
Looking for live crawling solution?
 
Request Information
 
SUBMIT REQUIREMENT
  • This field is for validation purposes and should be left unchanged.
  • This field is for validation purposes and should be left unchanged.
  • This field is for validation purposes and should be left unchanged.
  • This field is for validation purposes and should be left unchanged.
  • This field is for validation purposes and should be left unchanged.
  • This field is for validation purposes and should be left unchanged.
  • This field is for validation purposes and should be left unchanged.