首页 > 编程语言 > 详细

Python之旅 3·数据爬虫常见问题

时间:2021-08-30 10:02:19      阅读:26      评论:0      收藏:0      [点我收藏+]

解决python爬虫requests.exceptions.SSLError: HTTPSConnectionPool(host=‘XXX‘, port=443)问题

方法:先检查pip有没安装cryptography,pyOpenSSL,certifi要是没有先安装
  pip install cryptography
  pip install pyOpenSSL
  pip install certifi

连接MySQL数据库问题

方法:

import pymysql
# 建立数据库连接
def getDBConnection():
    print(***************getDBConnection start)
    host = 127.0.0.1
    port = 3306
    user = root
    password = 123
    db = music
    charset = utf8

    DBConnection = pymysql.connect(host=host, port=port, user=user, password=password, db=db, charset=charset)
    return DBConnection

# 保存音乐信息到数据库中
def saveMusicToDB(m_id, m_name, m_link, m_type, m_singer, m_album, m_click, m_collect):
    print(**********************saveMusicToDB start)
    DBConnection = getDBConnection()
    print(dbconnection= + str(DBConnection))
    # 创建 游标
    cursor = DBConnection.cursor()
    sql = insert into orgmusic(m_id,m_name,m_link,m_type,m_singer,m_album,m_click,m_collect) values(%s,%s,%s,%s,%s,%s,%s,%s)
    cursor.execute(sql, (m_id, m_name, m_link, m_type, m_singer, m_album, m_click, m_collect))

爬虫所需包

方法:

import urllib.request
from bs4 import BeautifulSoup
import pymysql
import datetime
import random
import gzip

 

 

 

 

Python之旅 3·数据爬虫常见问题

原文:https://www.cnblogs.com/herotxl/p/15194954.html

(0)
(0)
   
举报
评论 一句话评论(0
关于我们 - 联系我们 - 留言反馈 - 联系我们:wmxa8@hotmail.com
© 2014 bubuko.com 版权所有
打开技术之扣,分享程序人生!