Peiguang Chen, Dongqi Li, Yihan Ding, Xuanduo Yu, Shunjie Han
{"title":"Research on the Acquisition and Processing of Multidimensional Power System Data Based on Web Crawlers","authors":"Peiguang Chen, Dongqi Li, Yihan Ding, Xuanduo Yu, Shunjie Han","doi":"10.1109/RCAE56054.2022.9995971","DOIUrl":null,"url":null,"abstract":"The digital transition of power companies has led to an explosion of all types of information. However, due to different standards and distinctive calibers, the information has not been effectively and deeply applied in the power systems. Electric power companies have a real demand for timely, accurate, and intelligent access to various information in the power industry. In this paper, we use the data acquisition technology, including Pandas, Numpy, BeautifulSoup, and other tool libraries, to build a data acquisition system that consists of an information data capture module, a data filtering module, and a data processing module. The related technologies of data storage and processing are also studied.","PeriodicalId":165439,"journal":{"name":"2022 5th International Conference on Robotics, Control and Automation Engineering (RCAE)","volume":"16 3","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-10-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 5th International Conference on Robotics, Control and Automation Engineering (RCAE)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/RCAE56054.2022.9995971","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
The digital transition of power companies has led to an explosion of all types of information. However, due to different standards and distinctive calibers, the information has not been effectively and deeply applied in the power systems. Electric power companies have a real demand for timely, accurate, and intelligent access to various information in the power industry. In this paper, we use the data acquisition technology, including Pandas, Numpy, BeautifulSoup, and other tool libraries, to build a data acquisition system that consists of an information data capture module, a data filtering module, and a data processing module. The related technologies of data storage and processing are also studied.
京公网安备 11010802042870号
京ICP备2023020795号-1
分享
求助内容：
应助结果提醒方式：
扫码关注我们
