基于python的网络爬虫设计

AbstractBilibili has started as an unfamous acg web at the beginning and now have ahuge scale of over 100 million active users each mouth,which is causing a waveand attracted more and more people to choose to become a UPloader.Bilibili provides Uploaders sport and various functions for the users,but itstill cannot cover everything.This software is designed to provide convenientand needed functions to users.This graduation design uses a standard software development process,including requirements analysis,overall design,module implementation,coding,testing,packaging and other steps.The software algorithm and outline aredesigned based on python,and call the mature integrated library environmentincluding requests,random,pickle and so on.The software is mainly designedand implemented to slove two main functions with many user needs:reviewsand lotteries.The review function incuding crawling complete form datas,solving theacquisition and storage of multiple layers of reviews,realizing quick browsing,storage and multiple search functions and so on.The lottery function containscrawling multiple datas to analysis and finally finish the random choise.Key words:Web Crawler Bilibili User Python