Python网络爬虫及数据可视化

北京理工大学珠海学院2020届本科生毕业设计Python Web Crawler And Data VisualizationAbstractWith the full popularity of 4G and the construction of 5G base stations,the rapiddevelopment of Internet-related industries has brought about explosive growth of electronicdata.For Internet companies,the huge amount of data brought by massive users is the goldmine to be mined,and the data is also the lifeline of Internet companies.Obtaining hugeamounts of data manually is slow,time-consuming,and inefficient.For this pain point,webcrawlers are the best choice.With the assistance of a computer,you can obtain massiveamounts of valuable data.The bilibili barrage website(Referred to as B Station)is a popularwebsite among young people in recent years.Users tend to be post-90s or even 00s.They aremore interested in the user objects of the site and friendly to crawlers.This topic uses Python as the development language,write crawlers with the requestlibrary,and MySQL as the database for storing data.In the subsequent data visualization,Python is used for analysis.Through this program,you can efficiently obtain data,filter data,and store data,Analyze data,data visualization.Keywords:web crawler;Python;bilibili barrage website;data visualization