Discover the hidden costs of in-house web scraping
Customized 404 / Freshness Checker for URLs
With websites that link back to the original source for a particular piece of information, there’s an inherent problem of maintaining freshness of those links. Let’s take an example of a digital classified ad listing company that aggregates various ads from multiple sources on the web, and links each such ad back to its source […]
Read MoreTargeting International Clients – how we bypassed into them
It was only when someone asked us- “How many Indian clients do you guys serve currently?”, did we realize that we were only serving 2 at that point and had directly gone international since PromptCloud’s inception. How this happened- unintentionally and why this happened- we can closely guess. The Indian ecosystem wasn’t ready for such […]
Read MoreWhat enterprises do with Big Data- Part 2
It’s amusing how Big Data is knocking doors these days and so it took a while to settle down with the overwhelming response on the previous post. Here’s the next one. Notes- a) Notes that applied to the previous batch apply here too. b) Only public data gets crawled in the process and robots.txt is strictly […]
Read More
