Application of Improved Feature Pre-processing Method in Prevention and Control of Electricity Charge Risk

doi:10.23940/ijpe.19.09.p19.24532461

Abstract

Abstract: With the increase in power data, past data processing technologies cannot meet the needs of rapid processing and intelligent analysis of massive data. In order to solve the problems of current performance bottleneck in the calculation of power big data and recover users' electricity tariff arrears in a timely manner, we use the technology of combining parallel computing with feature expansion to establish a feature expansion method based on Spark distributed computing (FESDC). According to the data generated by the proposed method, we use a parallel logistic regression model to predict the arrears probability of future electricity users, which can effectively prevent and resolve the risk of electricity tariff recovery (ETR). Compared with the data processing method for single process (DPSP), the proposed method not only increased the accuracy of prediction, but also improved the performance of processing data.

Key words: Power big data, electricity tariff recovery, Spark, feature processing

Huaiguang Wu, Yongsheng Shi, Shenyi Qian, Hongwei Tao, and Jiangtao Ma. Application of Improved Feature Pre-processing Method in Prevention and Control of Electricity Charge Risk [J]. Int J Performability Eng, 2019, 15(9): 2453-2461.

Add to citation manager EndNote|Reference Manager|ProCite|BibTeX|RefWorks

References

1. S. Y. Chen, S. F. Song, L. X. Li,J. Shen, “Survey on Smart Grid Technology,” Power System Technology, Vol. 33, No. 8, pp. 1-7, 2009
2. B. Berwyn-Taylor and C. E. Dingley, “Conversion to Prepayment Metering in Parow,” inProceedings of 3D Africon Conference, pp. 529-532, Ezulwini Valley, Swaziland, September 1992
3. J. Q.Azasoo and K. O. Boateng, “Smart Metering: A GSM Approach in Ghana,” inProceedings of IEEE 4th International Conference on Adaptive Science and Technology (ICAST), pp. 158-163, Kumasi, Ghana, October 2012
4. H. Zhou, Y. Wang, W. Wang, T. Li,H. Yang, “Predication of Default Probability of Clients' Electricity Charges Arrears based on Logistic Regression Model,” Power System Technology, Vol. 31, No. 17, pp. 85-88, 2007
5. H. Zhou, Y. Wang, W. Wang, L. Tao,Y. Hong, “Prediction of Default Probability of Clients' Electricity Charge Arrears,” inProceedings of IEEE International Conference on Service Operations and Logistics, and Informatics, pp. 2582-2586, Beijing, China, October 2008
6. H. Zhou, Y. Wang, W. Wang, L. Tao,Y. Hong, “Arrears Forewarning Fodel for Power Clients in Electricity Market,”Proceedings of the CSEE, No. 22, pp. 107-112, 2008
7. J. Wang and Y. Wen, “Application of Data Mining in Arrear Risks Prediction of Power Customer,” in Proceedings of International Symposium on Knowledge Acquisition and Modeling, Wuhan, China, December 2008
8. Y. S.Huang and Y. Ying, “Research of Evaluating Credit-Risk in Power Enterprise based on SVM and VIKOR Method,” in Proceedings of IEEE International Conference on Industrial Engineering and Engineering Management, Singapore, Singapore, December 2008
9. Z. C.Yang and H. Kuang, “Credit Evaluation for Mobile Customers using Artificial Immune Algorithms,” in Proceedings of World Congress on Intelligent Control and Automation, Chongqing, China, June 2008
10. Z. Shaomin, Y. Sha,W. Baoyi, “A Trust Evaluation Model of Electricity Customers based on Cloud Model,” in Proceedings of International Conference on Computer Application and System Modeling (ICCASM 2010), Vol. 3, pp. V3-644-V3-649, Taiyuan, China, October 2010
11. R. G. Rogério, R. N. Carvalho, M. Ladeira,R. S. Carvalho, “Predicting Recovery of Credit Operations on a Brazilian Bank,” inProceedings of IEEE International Conference on Machine Learning and Applications (ICMLA), pp. 780-784, Anaheim, CA, USA, December 2016
12. Z. Xiao, X. Feng, L. Dang, R. Qiu, S. He, P. Chen, et al., “Research and Application of Subtilized Customer Clustering Algorithm in Power Marketing,” inProceedings of IEEE Conference on Energy Internet and Energy System Integration (EI2), pp.1-6, Beijing, China, November 2017
13. X. M. Zhang, W. Tao, J. J. Hu, C. F. Li, Y. S. Xu,Z. X. Zhang, “Study on Tariff Risk Early Warning of Electric Power Users based on PSO-SVM Algorithm,” inProceedings of International Conference on Big Data and Artificial Intelligence (BDAI), pp. 92-96, Beijing, China, June 2018
14. W. Fu, D. Zhang, Y. Fu, J. Li,Y. Xie, “Arrears Prediction for Electricity Customer through Wgan-Gp,” inProceedings of IEEE 2nd Information Technology, Networking, Electronic and Automation Control Conference (ITNEC), pp. 1667-1670, Chengdu, China, December 2017
15. M. Zaharia, R. S. Xin, P. Wendell, T. Das, M. Armbrust, A. Dave, et al., “Apache Spark: A Unified Engine for Big Data Processing,” Communications of the ACM, Vol. 59, No. 11, pp. 56-65, November 2016
16. J. Dean and S. Ghemawat, “MapReduce: Simplified Data Processing on Large Clusters,” Communications of the ACM, Vol. 51, No. 1, pp. 107-113, January 2008
17. T. White, “Hadoop: The Definitive Guide,” O'Reilly Media, Inc., 2012
18. S. H.Walker and D. B. Duncan, “Estimation of the Probability of an Event as a Function of Several Independent Variables,” Biometrika, Vol. 54, No. 1-2, pp. 167-179, June 1967
19. D. R. Cox, “The Regression Analysis of Binary Sequences,” Journal of the Royal Statistical Society: Series B (Methodological), Vol. 21, No. 1, pp. 215-232, July 1958
20. S. Aksoy and R. M. Haralick, “Feature Normalization and Likelihood-based Similarity Measures for Image Retrieval,” Pattern Recognition Letters, Vol. 22, No. 5, pp. 563-582, April 2001

[1]	Priyanshu Verma, Ishan Sharma, Sonia Deshmukh, and Rohit Vashisht. Customer Churn Analysis using Spark and Hadoop [J]. Int J Performability Eng, 2023, 19(10): 663-675.
[2]	Mansi Mahendru and Sanjay Kumar Dubey. Portable Learning Approach towards Capturing Social Intimidating Activities using Big Data and Deep Learning Technologies [J]. Int J Performability Eng, 2022, 18(9): 668-678.
[3]	Poonam Narang, Ajay Vikram Singh, and Himanshu Monga. Hybrid Metaheuristic Approach for Detection of Fake News on Social Media [J]. Int J Performability Eng, 2022, 18(6): 434-443.
[4]	Shenyi Qian, Yongsheng Shi, Huaiguang Wu, and Songtao Shang. Prediction of Electricity Tariff Recovery Risk based on Hybrid Feature Selection Algorithm [J]. Int J Performability Eng, 2020, 16(6): 846-854.
[5]	Hui Xu, Qianqian Cao, Heng Fu, and Hongwei Chen. Applying an Improved Elephant Herding Optimization Algorithm with Spark-based Parallelization to Feature Selection for Intrusion Detection [J]. Int J Performability Eng, 2019, 15(6): 1600-1610.
[6]	Jinhong Tao, Jianhou Gan, and Bin Wen. Collaborative Filtering Recommendation Algorithm based on Spark [J]. Int J Performability Eng, 2019, 15(3): 930-938.
[7]	Wenfang Zhao, Jingli Wang, Dongchang Yu, and Ge Zhang. Prediction of Daily Pollen Concentration using Support Vector Machine and Particle Swarm Optimization Algorithm [J]. Int J Performability Eng, 2018, 14(11): 2808-2819.