Traditional Culture Encyclopedia - Traditional culture - What does hadoop mean? What is the relationship with big data?

What does hadoop mean? What is the relationship with big data?

I. What does hadoop mean?

Hadoop is the specific open source framework, is the tool, used to do the storage and calculation of massive data.

Two, hadoop and the relationship between big data

First of all, big data itself involves a huge technical system, from the point of view of the disciplines, involves three major disciplines of mathematics, statistics and computers, but also involves sociology, economics, medicine and other disciplines, so the amount of knowledge of big data itself is still very large

From a disciplinary point of view, it involves three major disciplines: mathematics, statistics and computer science, as well as sociology, economics and medicine.

From the current industrial chain in the field of big data, the field of big data involves data collection, data storage, data analysis and data application, etc., different links need to use different technologies, but these links are often dependent on the big data platform, and Hadoop is one of the more popular big data platform.

Hadoop platform after years of development has formed a more complete ecosystem, and because the Hadoop platform is open source, so many commercial big data platform is also based on Hadoop build, so for the beginning of the big data technicians, from Hadoop to start learning is a good choice.

The current Hadoop platform is constantly being improved, not only in terms of data storage, but also in terms of data analysis and data application, so for current big data application developers, the overall knowledge structure is often organized around the big data platform. As big data platforms gradually begin to land in traditional industry sectors, the degree of dependence of big data technicians on big data platforms will become higher and higher.

Currently engaged in big data development positions can be divided into two categories, one is the big data platform development, this type of position is often the R & D level positions, not only the position of higher value-added, the future development of space is also relatively large, but the big data platform development for the practitioner's requirements are relatively high, there are a lot of graduate students will be engaged in the development of the big data platform after graduation positions.

The other category is the big data application development positions, this kind of job task is based on the big data platform (Hadoop, etc.) to carry out industry application development, in the era of the industrial Internet, the number of big data application development positions is still relatively large, and big data application development positions for the practitioner's requirements are relatively low.