There are numerous businesses out there hunting for price/ availability data
on specific products or products from a particular category
. There are others that would like to get hold of consumer reviews on the products that matter to them. This data is further processed to gain insights by running various analyses.
Unfortunately, this flow is not as simple as writing the above two statements. Firstly, all this data is not available at a single location and no enterprise is content with limited data from a single source. Secondly, processing this amount of information is a daunting task which needs expertise and resources. Finally, while one crawls all this data, focus on the core business is lost as crawling and extraction of such data requires regular monitoring.