首页 > 编程语言 > 详细

利用python爬取网页图片

时间:2020-07-24 16:38:05      阅读:97      评论:0      收藏:0      [点我收藏+]
"""利用python爬取网页图片"""
import requests
import urllib
from bs4 import BeautifulSoup
import json

headers = {
    ‘User-Agent‘: ‘Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.61 Safari/537.36‘
}
url = ‘http://pic.sogou.com/pics/recommend?category=明星‘
response = requests.get(url=url, headers=headers)
soup = BeautifulSoup(response.text, ‘html.parser‘)
print(soup.select(‘img‘))


def getSogouImg(category, length, path):
    url = ‘https://pic.sogou.com/pics/channel/getAllRecomPicByTag.jsp?category=‘ +         category + ‘&tag=全部&start=0&len=‘ +         str(length) + ‘&width=1920&height=1080‘
    imgs = requests.get(url=url, headers=headers)
    jd = json.loads(imgs.text)
    jd = jd[‘all_items‘]
    imgs_url = []
    for j in jd:
        imgs_url.append(j[‘ori_pic_url‘])
    m = 0
    for img_url in imgs_url:
        print(‘------‘ + str(m) + ‘.jpg------‘ + ‘    Downloading...‘)
        urllib.request.urlretrieve(img_url, path + str(m) + ‘.jpg‘)
        m += 1
    print(‘Download complete!‘)

getSogouImg(‘壁纸‘, 3000, ‘d:/Download/壁纸/‘)

转载自:https://www.cnblogs.com/dearvee/category/966215.html

利用python爬取网页图片

原文:https://www.cnblogs.com/memory-ccy/p/13372121.html

踩
(0)
赞
(0)
   
举报
评论 一句话评论(0)
关于我们 - 联系我们 - 留言反馈 - 联系我们:wmxa8@hotmail.com
© 2014 bubuko.com 版权所有
打开技术之扣,分享程序人生!