基本环境配置
- python 3.6
- pycharm
- requests
- parsel
相关模块pip安装即可
目标网页
请求网页
import requests url = \'https://www.tukuppt.com/peiyue/zonghe_0_0_0_0_0_0_1.html\' headers = { \'User-Agent\': \'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/81.0.4044.138 Safari/537.36\', } response = requests.get(url=url, headers=headers)
解析网页,提取数据
import parsel selector = parsel.Selector(response.text) urls = selector.css(\'#audio850995 source::attr(src)\').getall() titles = selector.css(\'.b-box .info .title::text\').getall() data = zip(urls, titles) for i in data: mp3_url = \'https:\' + i[0] title = i[1]
保存数据
def download(url, title): response = requests.get(url=url, headers=headers) path = \'D:\\\\python\\\\demo\\\\熊猫办公素材\\\\背景音乐\\\\\' + title + \'.mp3\' with open(path, mode=\'wb\') as f: f.write(response.content)
以上就是本文的全部内容,希望对大家的学习有所帮助,也希望大家多多支持自学编程网。