Spark Analysis Technology in Engineering Project Management Support in Big Data Scenarios

被引:0
|
作者
Huang, Chen [1 ]
机构
[1] Wenhua Coll, Wuhan 430074, Hubei, Peoples R China
关键词
Big Data Analysis; Data Mining; Apache Spark; Engineering Project Management Support; Model Performance;
D O I
10.1145/3662739.3672305
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Engineering project management support plays a crucial role in modern engineering projects, improving the efficiency and level of project management, reducing project risks, and ensuring the smooth implementation and successful delivery of projects through planning, execution, monitoring, and analysis functions. However, traditional engineering project management support encounters many problems such as large amount of data, inefficiency, and data dispersion. In order to solve these problems, this paper uses Apache Spark technology to build a Spark-based big data analysis model to achieve the prediction of the project schedule, and data mining and analysis, etc. The experimental results show that the precision rate of the prediction of the project schedule reaches 92.76%, the recall rate reaches 92.54%, and the F1 value is 0.926, and the system's runtime is significantly higher than that of other algorithms, and although the speed gradually decreases with the increase of data volume, it always stays above 14GB/min.
引用
收藏
页码:188 / 192
页数:5
相关论文
共 50 条
  • [1] Research on Practical Application of Big Data Mining Technology in Engineering Project Management
    Jia, Yanli
    PROCEEDINGS OF THE 2015 INTERNATIONAL CONFERENCE ON EDUCATION TECHNOLOGY AND ECONOMIC MANAGEMENT, 2015, 22 : 53 - 60
  • [2] Big data: A new perspective of the engineering project management driven by data
    Yang, Qing
    Wu, Gaoning
    Wang, Lizhen
    Xitong Gongcheng Lilun yu Shijian/System Engineering Theory and Practice, 2017, 37 (03): : 710 - 719
  • [3] Big Data Management Processing with Hadoop MapReduce and Spark Technology: A Comparison
    Verma, Ankush
    Mansuri, Ashik Hussain
    Jain, Neelesh
    2016 SYMPOSIUM ON COLOSSAL DATA ANALYSIS AND NETWORKING (CDAN), 2016,
  • [4] THE USE OF SOFTWARE ENGINEERING DATA IN SUPPORT OF PROJECT-MANAGEMENT
    ANDERSEN, O
    SOFTWARE ENGINEERING JOURNAL, 1990, 5 (06): : 350 - 356
  • [6] The Applied Exploration of Big Data Technology in Prefabricated Construction Project Management
    Han, Zixin
    Wang, Yaowu
    ICCREM 2017: PREFABRICATED BUILDINGS, INDUSTRIALIZED CONSTRUCTION, AND PUBLIC-PRIVATE PARTNERSHIPS, 2017, : 71 - 78
  • [7] The Concept of Project Management Platform using BI and Big Data Technology
    Pondel, Jolanta
    Pondel, Maciej
    PROCEEDINGS OF THE 18TH INTERNATIONAL CONFERENCE ON ENTERPRISE INFORMATION SYSTEMS, VOL 1 (ICEIS), 2016, : 166 - 173
  • [8] Research on Practice and Application of Big Data Mining Technology in Project Management
    Jia, Yanli
    PROCEEDINGS OF THE 2015 INTERNATIONAL CONFERENCE ON EDUCATION TECHNOLOGY AND ECONOMIC MANAGEMENT, 2015, 22 : 160 - 166
  • [9] Product data management system-based support for engineering project management
    Mesihovic, S
    Malmqvist, J
    Pikosz, P
    JOURNAL OF ENGINEERING DESIGN, 2004, 15 (04) : 389 - 403
  • [10] Hadoop and Spark for Data Management, Processing and Analysis of Astronomical Big Data: Applicability and Performance
    Harischandra, Lloyd
    ASTRONOMICAL DATA ANALYSIS SOFTWARE AND SYSTEMS XXV, 2017, 512 : 41 - 44