×

Download Our Latest Case Study

Explore how we helped India's leading lifestyle retailer use Big data solutions to track online presence and run competition analysis!!!

Name
Contact information

PromptCloud Inc, 16192 Coastal Highway, Lewes De 19958, Delaware USA 19958

We are available 24/ 7. Call Now. marketing@promptcloud.com
Avatar

Introduction To Modern Big Data:

Modern Big Data architecture is fast changing the world with its rapid pace and seamless usage it offers to the users. As we read in Part-1 and Part-2 of this 3 part series on Big Data. It has come a long way from its inception way back from the 1600s to recent modern-day Big Data. Data Mining and Big Data has come a long way since then and has changed the way people look at technology.

The First Data-Centric Agency

The effects of the combined events described in part 1 of this blog series, led to the creation of NSA (National Security Agency) of the USA by then-President Truman. The key activities of the staffers of NSA are to decrypt the messaged intercepted during the Cold War. The first data center was built by the US Government to store millions of fingerprint sets and tax returns. These records were stored in magnetic tape and stored in a central location, the first attempt at large-scale data storage.

           The National Security Agency of the United States of America

The First Internet

In 1969, the Advanced Research Projects Agency, a subdivision of Department of Defence, USA, funded a project called ARPANET which began when a message was sent from a host computer in UCLA to a host computer in Stanford. This is the birth of the Internet as we know it today. But later in 1989, the architecture started to age. Many organizations shifted from ARPANET to other Networks like NSFNET to increase efficiency and speed.

The First Data Centre

The first data center built by the US Government to store millions of fingerprints sets and tax returns. These records stored in magnetic tape and stored in a central location. But the project was closed due to the expressed concerns by various segments of people. This was the first attempt at a large-scale data storage.

Modern Big Data architecture

The First Personal Computer

 In 1977, microcomputers called Personal Computer introduced to the market. This is yet another milestone in the evolution of the internet and eventually the Big Data. The personal computers were much simpler and more accessible than a mainframe computer which required a large processor shared by multiple individuals and an operating staff or a system for shared access. Many of the early personal computers sold as electronic kits for hobbyists and enthusiasts.

Modern Big Data architecture

WWW

 A British scientist called Tim Berners-Lee working in CERN (European Council for Nuclear Research) invented the World Wide Web. His goal was to share information on the internet using the hypertext system which allowed the transfer of not just text data but also audio and video data as well. In 1993, The CERN announced the WWW. The key factor was that it was free for everyone to develop and use. The increase in the power and flexibility of personal computers and free access to WWW contributed to exponential growth on the internet in the following years.  

Modern Big Data architecture

Conclusion To Modern Big Data Architecture

In 2005, Hadoop created to handle modern Big Data architecture. This was based on an open-source software platform called Nutch. Because of its ability to process structured and unstructured data from almost all the digital resources and its flexibility HADOOP was able to process Big Data.

The internet and the WWW are the founding pillars for the modern Big Data. The immense volume of data is being derived from multiple ways such as the billions of websites, sensors, IoT, etc. the process of getting data from websites to use for analysis and other purposes is called Web Scraping.  PromptCloud Technologies is a pioneer and an industry leader when it comes to web scraping services. 

Sharing is caring!

Recent post

How to Scrape Website Data without Coding
  • November 21, 2022
Analyze Data Using Azure Web Scraping
How to Analyze Data Using Azure Web
  • November 15, 2022
Web scraping airline data
Web Scraping Airline Data – A Boon
  • November 9, 2022
web scraping with google sheets
Using Google Sheets as a Basic Web
  • November 7, 2022
web data crawling
Setting up Web Data Crawling APIs –
  • November 2, 2022
Open-source web scrapers
How an Open-Source Web Scraper is Useful
  • October 31, 2022
Click on Contact Us below to Get started with your Project Requirements

Are you looking for a custom data extraction service?

Contact Us