首页 > 编程语言 > 详细

爬虫之多线程,提高效率

时间:2021-02-19 09:50:27      阅读:30      评论:0      收藏:0      [点我收藏+]
技术分享图片
arr = ["http://music.163.com/song/media/outer/url?id=1820550501.mp3",
"http://music.163.com/song/media/outer/url?id=1820550501.mp3",
"http://music.163.com/song/media/outer/url?id=1820550501.mp3",
"http://music.163.com/song/media/outer/url?id=1820550501.mp3",
"http://music.163.com/song/media/outer/url?id=1820550501.mp3",
"http://music.163.com/song/media/outer/url?id=1820550501.mp3",
"http://music.163.com/song/media/outer/url?id=1820550501.mp3",
"http://music.163.com/song/media/outer/url?id=1820550501.mp3",
"http://music.163.com/song/media/outer/url?id=1820550501.mp3",
"http://music.163.com/song/media/outer/url?id=1820550501.mp3",
"http://music.163.com/song/media/outer/url?id=1820550501.mp3"]

import random
def downsong(url):
    res = requests.get(url,headers=headers)
    with open(f"D://music/{str(random.randint(1,100))}.mp3","wb")as f:
        f.write(res.content)

from multiprocessing.dummy import Pool
p = Pool(4)
p.map(downsong,arr)
print("下载完毕")
View Code

下载网易云 使用多线程爬虫

爬虫之多线程,提高效率

原文:https://www.cnblogs.com/3-wusen/p/14414168.html

(0)
(0)
   
举报
评论 一句话评论(0
关于我们 - 联系我们 - 留言反馈 - 联系我们:wmxa8@hotmail.com
© 2014 bubuko.com 版权所有
打开技术之扣,分享程序人生!