Clicky

Scrape Medicine Details from Pharmaceutical Websites | PromptCloud
 

Scrape Medicine Details from Pharmaceutical Websites

Company: A popular healthcare research firm from Netherlands.

Context: Client wanted to extract medicine details from the catalogs of leading pharmaceutical portals.


Scrape medicine details

Challenge

Client wanted to extract data for medicines under all the categories available on the pharmaceutical portals at regular intervals to perform analyses over a period of three years. This would result in  significant record volume requiring an infrastructure capable of handling big data.

The data points that they needed were:

  • Disease/Condition Name
  • Manufacturer Name
  • Salt Name
  • Medicine Name
  • Price
  • Package Size

Solution

Our team built a custom crawler to regularly extract the required data at scale and deployed it. We also set up monitoring for the target websites in order to promptly update the crawler if the site structure changes. The client was provided with API details and documentation to query and fetch the crawled data.

Benefits:

  • The client didn’t have to be involved in the technical aspects of the process
  • The initial setup only took 3 days to get completed and the supply of data was consistent
  • We also setup monitoring for the target site to ensure consistent crawling and to avoid data loss
  • Our tech stack could efficiently handle the dynamic coding practices used by the target sites
  • The client could get ready to use data to power their research project
  • The cost of extraction was 78%  less than the cost of  an in-house crawling setup  projected by the client

Ready to discuss your requirements?

REQUEST A QUOTE
  • This field is for validation purposes and should be left unchanged.
  • This field is for validation purposes and should be left unchanged.
  • This field is for validation purposes and should be left unchanged.
  • This field is for validation purposes and should be left unchanged.
  • This field is for validation purposes and should be left unchanged.
  • This field is for validation purposes and should be left unchanged.
  • This field is for validation purposes and should be left unchanged.
  • This field is for validation purposes and should be left unchanged.
  • This field is for validation purposes and should be left unchanged.

Price Calculator

  • Total number of websites
  • number of records
  • including one time setup fee
  • from second month onwards
  • This field is for validation purposes and should be left unchanged.
  • This field is for validation purposes and should be left unchanged.
  • This field is for validation purposes and should be left unchanged.
  • This field is for validation purposes and should be left unchanged.
  • This field is for validation purposes and should be left unchanged.
  • This field is for validation purposes and should be left unchanged.
  • This field is for validation purposes and should be left unchanged.
  • This field is for validation purposes and should be left unchanged.
  • This field is for validation purposes and should be left unchanged.