Why Docker

Docker means Docker, and the function of Docker is similar to that of a container. Usually a webapp does not use all the functions of the operating system/virtual machine, that is, the operating system/virtual machine is too bulky for a webapp. For example, if I want to go from the dormitory to the cafeteria. I don’t need an airplane, I only need a bicycle. The Docker image is equivalent to a bicycle. You can understand the Docker image as a lightweight virtual machine, of course the two are different, but it is beyond the scope of this tutorial.

How to use Docker

Imagine a…

In the era of big data, if you want to be an excellent data analyst, your skill tree must be very large.

Among them are the two most important aspects

1. Practical ability
2. Business analysis ability

It is no exaggeration to say that, whether you engage in any internet-related data analysis, has a strong business analytics capabilities will make your career development path becomes more clear and have direct impact on the salary.

But the reality is that many people do not even work through the most basic and complete process of data analysis for actual business.

Don’t think that you…

Simply put, from the perspective of the life cycle of big data, there are nothing more than four aspects

1. Big data collection
2. Big data preprocessing
3. Big data storage
4. Big data analysis

All above four together constitute the core technology in the big data life cycle.

Big data collection

Big data collection is the collection of structured and unstructured massive data from various sources.

Database collection: Sqoop and ETL are popular, and traditional relational databases MySQL and Oracle still serve as data storage methods for many enterprises. …

Transformative impact

The current development of artificial intelligence mainly benefits from machine learning technology represented by deep learning, which allows computers to learn and evolve autonomously from a large amount of data, to make predictions and decisions that are more efficient, more accurate, and cheaper than humans. For this reason, as a new general-purpose technology, artificial intelligence is considered to have a transformative impact on the economy and society. It has been raised to the height of national strategy and technological sovereignty by countries, and has become the new focus of the ever-increasing global technological competition.

Artificial intelligence penetration

At the application level, artificial intelligence…

Currently, this generation of information technology represented by big data, the Internet, and artificial intelligence is developing vigorously, and has a huge and far-reaching impact on social progress, national economic development, and people’s lives.

What is big data

In May 2011, the McKinsey Institute issued an announcement-Big data the next frontier for innovation, competition, and productivity, which for the first time gave a relatively clear definition of big data: “Big data means that its size is beyond the norm. Database tools acquire, store, manage and analyze data sets.”

Big data is a data collection with large capacity, multiple types, fast access speed, and high…

Currently, the value of data has been recognized and valued by society. The value generated by the aggregation and processing of massive data drives the in-depth development of the digital economy. Data deserves its name as a new production factor. However, there is a well-known paradox between data sharing and data privacy. Data sharing has brought about the problem of data boundaries and non-controllability of data, and has also made privacy and security issues increasingly prominent.

For issues such as privacy and security caused by data, data governance that can control data and let data sharing benefit mankind has become…

The development of artificial intelligence has made people gradually realize that the big data that algorithms rely on are not neutral. They are drawn from the real society, and they are bound to bear the traces of inequality, exclusion and discrimination inherent in society.

As early as the 1980s, St. George’s Medical College in London used computers to browse enrollment resumes and initially screened applicants. However, after four years of operation, it was discovered that this procedure would ignore the applicant’s academic performance and directly reject female applicants and applicants without European names. …

Data analysts refer to those professionals who specialize in collecting, sorting, and analyzing domain data in different industries, and research, evaluation, and prediction based on the data. In this era of machine learning, the position of data analyst is gradually being known by more and more people.

The so-called algorithm is just calculating according to human thinking logic and programming. Even with AI, algorithm logic is human. Artificial intelligence is [human intelligence + machine computing], and the machine wins in computing compare to humans good in abstract thinking.

A data analyst is an extractor of the commercial value of industry…