- 2024-08-16Scrapy框架进阶攻略:代理设置、请求优化及链家网实战项目全解析
scrapy框架加代理付费代理IP池middlewares.py#代理IP池classProxyMiddleware(object):proxypool_url='http://127.0.0.1:5555/random'logger=logging.getLogger('middlewares.proxy')asyncdefprocess_request(self,request,spider):
- 2024-08-12Scrapy框架进阶攻略:代理设置、请求优化及链家网实战项目全解析
scrapy框架加代理付费代理IP池middlewares.py#代理IP池classProxyMiddleware(object):proxypool_url='http://127.0.0.1:5555/random'logger=logging.getLogger('middlewares.proxy')asyncdefprocess_request(self,request,spider):