Abstract: Big data, Internet of Things (IoT) and Cloud computing are the most profound changes in the development of new information technologies. With IoT, thousands of network sensors are embedded in the real world, and cloud computing provides the storage space and on-line processing service for the mass data generated by IoT, while big data contributes to value in the mass data. In this paper, it firstly introduces Cloud computing related knowledge and technology, followed by the description of big data and its general processing flow, then the relationship between container technology and cloud computing is described, and construction programs for big data platform based on cloud computing container technology is proposed. Finally, it proposes the optimization scheme of the platform, as well as the technical challenges faced by high-performance computing with respect to big data.
Loading