首页 > 其他分享 >爬虫新问题

爬虫新问题

时间:2023-12-20 22:23:56浏览次数:24  
标签:python py 爬虫 问题 File python310 line software

Traceback (most recent call last):
File "D:\software\python\python310\lib\site-packages\urllib3\connectionpool.py", line 790, in urlopen
response = self._make_request(
File "D:\software\python\python310\lib\site-packages\urllib3\connectionpool.py", line 536, in _make_request
response = conn.getresponse()
File "D:\software\python\python310\lib\site-packages\urllib3\connection.py", line 461, in getresponse
httplib_response = super().getresponse()
File "D:\software\python\python310\lib\http\client.py", line 1375, in getresponse
response.begin()
File "D:\software\python\python310\lib\http\client.py", line 318, in begin
version, status, reason = self._read_status()
File "D:\software\python\python310\lib\http\client.py", line 287, in _read_status
raise RemoteDisconnected("Remote end closed connection without"
http.client.RemoteDisconnected: Remote end closed connection without response

The above exception was the direct cause of the following exception:

urllib3.exceptions.ProxyError: ('Unable to connect to proxy', RemoteDisconnected('Remote end closed connection without response'))

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "D:\software\python\python310\lib\site-packages\requests\adapters.py", line 486, in send
resp = conn.urlopen(
File "D:\software\python\python310\lib\site-packages\urllib3\connectionpool.py", line 844, in urlopen
retries = retries.increment(
File "D:\software\python\python310\lib\site-packages\urllib3\util\retry.py", line 515, in increment
raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='seller.ozon.ru', port=443): Max retries exceeded with url: /api/site/seller-analytics/what_to_sell/data/v3 (Caused by ProxyError('Unable to connect to proxy', RemoteDisconnected('Remote end closed connection without response')))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "D:\mycode\python\seller-project\main.py", line 22, in <module>
cs.get_result(item_id)
File "D:\mycode\python\seller-project\crawl\crawler_seller.py", line 107, in get_result
CrawlerSeller.myClient.insert_data(collect_name="collect_" + category_id,
File "D:\mycode\python\seller-project\crawl\crawler_seller.py", line 63, in post_url
response = requests.post(
File "D:\software\python\python310\lib\site-packages\requests\api.py", line 115, in post
return request("post", url, data=data, json=json, **kwargs)
File "D:\software\python\python310\lib\site-packages\requests\api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
File "D:\software\python\python310\lib\site-packages\requests\sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
File "D:\software\python\python310\lib\site-packages\requests\sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
File "D:\software\python\python310\lib\site-packages\requests\adapters.py", line 513, in send
raise ProxyError(e, request=request)
requests.exceptions.ProxyError: HTTPSConnectionPool(host='seller.ozon.ru', port=443): Max retries exceeded with url: /api/site/seller-analytics/what_to_sell/data/v3 (Caused by ProxyError('Unable to connect to proxy', RemoteDisconnected('Remote end closed connection without response')))

标签:python,py,爬虫,问题,File,python310,line,software
From: https://www.cnblogs.com/qizhang0828/p/17917738.html

相关文章

  • 远程桌面连接服务器黑屏问题
    连接了服务器之后,如果能看到鼠标但屏幕黑屏的情况下,可以采用这种方法:1、ctrl+art+delete可以打开本地的任务管理器2、在进程中,找到Windows进程,找到Windows资源管理器(我这里不是explore.exe)右键结束任务3、任务管理器左上角点击文件,运行新任务,输入C:\WINDOWS\explorer.e......
  • 软件测试/测试开发|selenium NoSuchDriverException问题解决
    前言我们在使用selenium进行web自动化测试时,有时候会遇到NoSuchDriverException的问题,这个异常通常是由于WebDriver无法找到指定的浏览器驱动而引起的。在这篇文章中,我们将讨论NoSuchDriverException的原因以及如何解决这个问题。NoSuchDriverException是什么?NoSuchDriverException......
  • 算法分析-动态规划-求解0-1背包问题
    一.题目需求 使用一个体积大小为13的背包,选择一件或多件商品带走,使得所选商品总价值最大。商品列表如下: 二.算法思想1,这是一个经典的0-1背包问题它要求我们在一组物品中选择一些,每个物品只能选择一次或者不选择,目标是使得所选物品的总价值最大。这个问题在实际生活中有很......
  • 线段树与历史最值和区间最值问题
    线段树与历史最值问题P4314CPU监控Description给定数组\(\{a_i\}\),维护以下操作。定义一个辅助数组\(\{b_i\}\),每次操作完后令\(b_i=\max(a_i,b_i)\)。查询\(\max_{i=l}^{r}a_i\)(区间最值)查询\(\max_{i=l}^{r}b_i\)(历史最值)\(\foralli\in[l,r]\),\(a_i\gets......
  • 测试-漏侧是能力问题?
    漏侧是能力问题?关于漏测的问题:一方面认同在一些边缘场景下总归会有遗漏;另一方面认为如果是非边缘场景还有遗漏,那是测试同学的能力不够。比起常听到的一切问题归测试的论断,这个评价已经算是比较客气的了。首先我不否认测试能力的确在较大程度上会影响测试结果,其次我也不认为非边......
  • Redis异常问题分析黄金一分钟
    Redis异常问题分析黄金一分钟背景同事发现一个环境redis比较卡顿,导致业务比较难以开展.问题是下午出现的.六点左右找到我这边.想着帮忙看看,问题其实没有定位完全,仅是发现了一个可能的点.所以想记录一下,备查步骤登录redis进行查看处理的过程:1.infomemor......
  • 关于在doker中部署superset后远程登录时原地跳转的问题
    排除密码错误后实时log查看报错:dockerlogs-fsuperset发现问题为flask_wtf.csrf:TheCSRFsessiontokenismissing.原因是Superset使用Flask和Flask-Login进行用户会话管理。以及TALISMAN_ENABLED这个对跨站点登陆有限制,需要关闭解决方案->**注意镜像内可能无法......
  • 5.经典进程同步问题
    生产者消费者问题一组生产者进程和一组消费者进程共享一个初始为空,大小为n的缓冲区。当缓冲区没满时,生产者才能把消息放入缓冲区,否则必须等待,只有缓冲区不空时,消费者才能从中取出消息,否则必须等待。由于缓冲区是临界资源,它只允许一个生产者放入消息,或一个消费者从中取出消息。......
  • 智能监测/检测系统/摄像头监控系统EasyCVR大华云台控制问题的解决方法
    GB28181视频集中存储/云存储/视频监控管理平台EasyCVR能在复杂的网络环境中,将分散的各类视频资源进行统一汇聚、整合、集中管理,实现视频资源的鉴权管理、按需调阅、全网分发、智能分析等。AI智能大数据视频分析EasyCVR平台已经广泛应用在工地、工厂、园区、楼宇、校园、仓储等场景......
  • formatter 和 scope 冲突不能同时使用失效问题
    formatter 和scope冲突不能同时使用否则就会失效解决办法:自己写 formatter方法:<divv-else-if="item.prop==='file_size'"><spanv-html="formatter(scope.row.file_size,item.prop)"></span></div> methods:{formatte......