What are the key technologies of traditional data acquisition? What is the relationship between them?

Big data collection technology, big data preprocessing technology, big data storage and management technology, big data analysis and mining technology, big data presentation and application technology.

Data collection refers to various types of structured, semi-structured (or weakly structured) and unstructured massive data obtained through RFID radio frequency data, sensor data, social network interaction data and mobile Internet data, which is the basis of big data knowledge service model. The key point is to break through the distributed high-speed and high-reliability data capture or acquisition, high-speed data full image and other big data acquisition technologies; Break through big data integration technologies such as high-speed data analysis, conversion and loading; Design quality evaluation model and develop data quality technology.

The storage and management of big data need to use memory to store the collected data, establish the corresponding database, and manage and call it. Focus on solving complex structured, semi-structured and unstructured big data management and processing technologies. It mainly solves several key problems such as storability, representability, treatability, reliability and effective transmission of big data. Develop reliable distributed file system (DFS), energy-saving optimized storage, computing integrated storage, big data redundancy and high-efficiency and low-cost big data storage technology; Break through the distributed non-relational big data management and processing technology, data fusion technology and data organization technology of heterogeneous data, and study big data modeling technology; Break through the big data indexing technology; Break through big data mobile, backup, replication and other technologies; Develop big data visualization technology.

Big data analysis technology. Improve the existing data mining and machine learning technology; Develop new data mining technologies such as data network mining, special group mining and graph mining; Break through data fusion technologies such as object-based data connection and similarity connection; Break through domain-oriented big data mining technologies such as user interest analysis, network behavior analysis and emotional semantic analysis.

Big data technology can dig out the information and knowledge hidden in massive data, and provide a basis for human social and economic activities, thus improving the operational efficiency of various fields and greatly improving the intensive degree of the whole social economy.