Full-process supported Simulation Platform Framework based on cloud computing and HPC integration
Abstract
Simulation technology is widely used in many fields, it usually involves three processes, (i) pre-process, (ii) analysis solver, and (iii) post-process. Simulation calculations require a large amount of computing resources, and users usually need to use cloud and High-Performance Computing (HPC) systems to complete works. Simulation works are increasingly depending on the capacity of HPC or cloud, for cost reasons, people are more willing to use the services than self-built an HPC or Cloud computing cluster. However, that leads to the isolation of calculations and pre- and post-processing work, adding additional time for data transfer. Moreover, simulation engineers also want to use cloud servers in pre-processing and post-processing, since compared with local workstations, cloud servers have significant advantages in saving hardware investment, remote office collaboration, and data integration management. Therefore, we provide a platform framework based on cloud computing and HPC integration that supports the full process of simulation. Then, we implemented it in Tianhe-1A and Tianhe exascale supercomputers and THCloud environments. Through a city area-level explosion simulation experiment, it was verified that the framework can fully support the whole process of simulation, and effectively reduce the time of simulation work, improving the simulation engineer’s work efficiency. The study shows that the platform provides a feasible solution for full-process simulation. Compared with other platforms, it has the characteristics of full-process, high performance and high security.
References
1. De Gregoriis, D., et al. (2019). Development and validation of a fully predictive high-fidelity simulation approach for predicting coarse road dynamic tire/road rolling contact forces. Journal of Sound and Vibration, 452, 147–168.
2. Yang, Y. B., Jiang, Y. L., & Kong, Q. X. (2019). The Arrow-Hurwicz iterative finite element method for the stationary magnetohydrodynamics flow. Applied Mathematics and Computation, 356, 347–361.
3. Bertozzi, B., et al. (2019). On the interactions between airflow and ice melting in ice caves: A novel methodology based on computational fluid dynamics modeling. Science of the Total Environment, 669, 322–332.
4. Wu, H., Wu, P. B., & Li, F. S. (2019). Fatigue analysis of the gearbox housing in high-speed trains under wheel polygonization using a multibody dynamics algorithm. Engineering Failure Analysis, 100, 351–364.
5. Lin, C. K., et al. (2019). Mechanical durability of solid oxide fuel cell glass-ceramic sealant/steel interconnect joint under thermo-mechanical cycling. Renewable Energy, 138, 1205–1213.
6. Petit, S. (2015). Current challenges in simulations of HPC systems. In 2015 International Conference on High Performance Computing & Simulation (HPCS), Amsterdam, Netherlands, 20–24 July, 2015, 653–655.
7. Ahmed, K., et al. (2017). A brief history of HPC simulation and future challenges. In 2017 Winter Simulation Conference (WSC), Las Vegas, USA, 03–06 , 419–430.
8. Kumar, D., Memon, S., & Thebo, L. A. (2018). Design, Implementation & Performance Analysis of Low Cost High Performance Computing (HPC) Clusters. In 2018 12th International Conference on Signal Processing and Communication Systems (ICSPCS), Cairns, Australia, 17–19.
9. Ochôa, P., Groves, R. M., & Benedictus, R. (2019). Systematic multiparameter design methodology for an ultrasonic health monitoring system for full-scale composite aircraft primary structures. Structural Control & Health Monitoring, 2340.
10. Zarchi, M., & Attaran, B. (2019). Improve design of an active landing gear for a passenger aircraft using multi-objective optimization technology. Structural and Multidisciplinary Optimization, 59, 1813–1833.
11. Wang, K., Shi, T. T., & He, Y. R. (2019). Case analysis and CFD numerical study on gas explosion and damage processing caused by aging urban subsurface pipeline failures. Engineering Failure Analysis, 97, 201–219.
12. Fang, P. C., Jiang, Y. C., & Zhong, R. Y. (2018). Real-time monitoring of workshop status based on internet of things. In The 48th International Conference on Computers and Industrial Engineering (CIE 48), Auckland, New Zealand, 2–5.
13. Jiang, Y. C., Pang, X. L., & Li, C. S. (2018). Design and development of Tianhe render cloud platform considering the background of industrial internet. In The 48th International Conference on Computers and Industrial Engineering (CIE 48), Auckland, New Zealand, 1–8.
14. Li, R. Z., et al. (2016). A Cost-Effective Approach of Building Multi-tenant Oriented Lightweight Virtual HPC Cluster. In 2016 7th International Conference on Cloud Computing and Big Data (CCBD), Macau, China, 16–18, 219–224.
15. Mancini, M., & Aloisio, G. (2015). How advanced cloud technologies can impact and change HPC environments for simulation. In 2015 International Conference on High Performance Computing & Simulation (HPCS), Amsterdam, Netherlands, 667–668.
16. Taylor, S. J. E., et al. (2018). The CloudSME simulation platform and its applications: A generic multi-cloud platform for developing and executing commercial cloud-based simulations. Future Generation Computer Systems, 88, 524–539.
17. Ieshkin, A., et al. (2015). Computer simulation and visualization of supersonic jet for gas cluster equipment. Nuclear Instruments and Methods in Physics Research A, 795, 395–398.
18. Hollman, J. A., Martí, J. R. (2003). Real Time Network Simulation With PC-Cluster. IEEE Transactions on Power Systems, 18, 563–569.
19. Borštnik, U., et al. (2012). Implementation of the Force Decomposition Machine for Molecular Dynamics Simulations. National Institutes of Health (NIH) Public Access, 38, 243–247.
20. O’Leary, P., et al. (2015). HPCCloud: A Cloud/Web Based Simulation Environment. In Proceedings of the 2015 7th IEEE International Conference on Cloud Computing Technology and Science, Vancouver, BC, Canada, 25–33.
21. Guzzetti, S., et al. (2017). Platform and algorithm effects on computational fluid dynamics applications in life sciences. Future Generation Computer Systems, 67, 382–396.
22. Hanai, M., et al. (2014). An adaptive VM provisioning method for large-scale agent-based traffic simulations on the cloud. 2014 IEEE 6th International Conference on Cloud Computing Technology and Science. Singapore,130–137.
23. Anderson, K., Du, J., Narayan, A., El Gamal, A. (2014). GridSpice: A Distributed Simulation Platform for the Smart Grid. IEEE Transactions on Industrial Informatics, 10, 2354–2363.
24. Deelman, E., Vahi, K., et al. (2016). Pegasus in the cloud: Science automation through workflow technologies. IEEE Internet Computing, 20, 70–76.
25. Salvadore, F., Ponzini, R. (2019). LincoSim: a web based HPC-cloud platform for automatic virtual towing tank analysis. Journal of Grid Computing, 17(4), 771–795.
26. Song, Y., Chen, Y., Yu, Z., et al. (2020). CloudPSS: A high-performance power system simulator based on cloud computing. Energy Reports, 6, 1611–1618.
27. Fang, Q., Yan, S. (2022). MCX Cloud—a modern, scalable, high-performance and in-browser Monte Carlo simulation platform with cloud computing. Journal of Biomedical Optics, 27(8), 083008.
28. Wolstencroft, K., et al. (2013). The Taverna work-flow suite: designing and executing work-flows of Web Services on the desktop, web or in the cloud. Nucleic Acids Research, 41, 557–561.
29. Qi, Y., Song, W. (2023). A Cloud-based Environment for Collaborative Aircraft Sizing Supported by a Full Parametric Geometry. AIAA SCITECH 2023 Forum, 0979.
30. Deng, Z., Zhang, J., Yin, H. (2016). Architecture of cloud platform for CAE simulation in supercomputing environment. International Journal of High Performance Systems Architecture, 6(3), 131–142.
31. Alam, S. R., Gila, M., Klein, M., et al. (2023). Versatile software-defined HPC and cloud clusters on Alps supercomputer for diverse workflows. The International Journal of High Performance Computing Applications, 37, 288–305.
32. Wang, Y. B., Blache, R., Zheng, P., Xu, X. (2018). A knowledge Management System to Support Design for Additive Manufacturing Using Bayesian Networks. Journal of Mechanical Design, 140.
33. Yoo, A. B., Jette, M. A., Grondona, M. (2003). Slurm: Simple linux utility for resource management. Lecture Notes in Computer Science, 2862, 44–60.
34. Theodoropoulos, D., Pekridis, G., Miliadis, P., et al. (2023). Early Results of Mapping Industrial Applications on Heterogeneous HPC Systems: The OPTIMA Project. Proceedings of the 20th ACM International Conference on Computing Frontiers, 304–308.
Copyright (c) 2024 Hao Wang, Jinghua Feng, Lin Wang
This work is licensed under a Creative Commons Attribution 4.0 International License.
Copyright on all articles published in this journal is retained by the author(s), while the author(s) grant the publisher as the original publisher to publish the article.
Articles published in this journal are licensed under a Creative Commons Attribution 4.0 International, which means they can be shared, adapted and distributed provided that the original published version is cited.
Submit a Paper
