首页 > 其他分享 >爬虫----request中的cookies参数

爬虫----request中的cookies参数

时间:2023-07-22 21:34:58浏览次数:36  
标签:GS1.1 cookies 0.0 request ---- ga print response

import  requests

# url='https://www.baidu.com/s?wd=python'
url='https://home.cnblogs.com/u/dddzy/'
# kw={'wd':'python'}
headers={'User-Agent':
'Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/78.0.3904.108 Safari/537.36'
# 'cookie':
# '_ga_7DSFGJNPL4=GS1.1.1689858308.1.1.1689858320.0.0.0; _ga_C2LFP3RFGH=GS1.1.1690027606.4.1.1690027935.0.0.0; .Cnblogs.AspNetCore.Cookies=CfDJ8DuWIYDefEVJtUW7VadsHY84qXnCo_l8ICXPKH_9HpPUUoLg0UexS-B3pggZ6-k4VcmwNfX8hC-_PTMWHEmcUrPrX-Z0HANU7_5m32oSqI9fyOFFXG_YwX2qeFt_iqobAYc2-QqQxBePBESquCkkTJO46Xm9uevpzSx6I_Q22Rq6JteIHuwkHSsQQwHeKRXB8dDs2K93OosWtC60LXuhgtQ_iEzUbmSvswC2IkvZoOgSWN4wEa1vz3JkPtFUKqSsIXDGFoF45PIbnsU176zLDVtMNFbGfLXIIXgr-N37l_caMDQ_jf83hMkcDUazIkS97lZI6DerpDFkThj-9kqJI8fUotjqVAV80bQViMduJa47W0ZUBpm_Y4uusk6xG41ADTKyxPT__bZ_wDdyGXS5npz6dD95YzCExRSW5vBPNNVGx-eisdo5aCnmt4NiH5vdtr9QyNXgfvvv2pn5yBgIyC-LAaMz2Pni1GI_wwkmdhtLMTjAEnyUdrYv9p2BAZb9cy1aVpi-aC1dO200N19-vwtVAJ9nQnJrknAIVDzuaIKkdwzd5UZhQn21_e0dLryXGulVCRoyRY2HTZmZUD9FqXQ; .CNBlogsCookie=DD77AEB0830213B71F3A677E8663D649FCE2668228EC3603F880DAA3C068B9581AF426158741EA3DC7A6AA7E74AF977FBC767B24F7C84CA69CBFC469A7245AB324F462F382A7399E576E99798F3C561C3B3383DD; _ga_3Q0DVSGN10=GS1.1.1690027762.6.1.1690028016.2.0.0; affinity=1690028046.3.308.352483|53e09caa9a86f4478a3056efca83512b; _gid=GA1.2.807364554.1690028045; __gads=ID=4bb592e3bd37fcaa:T=1689858308:RT=1690028818:S=ALNI_MZHDipyId3zfRXm-HxR1EkQm4MFOw; __gpi=UID=00000c22a50a8ca4:T=1689858308:RT=1690028818:S=ALNI_MaFUMjTbLjYEsOQEUnxSQsbf2aaFA; cto_bundle=Z6I1X19xJTJGVVVWV01zazlqVHJnZGxvZkxyREE0R0N3aGdvJTJGV0hLTEl6NjgwcTFLQ3E3blB6eE5ENnJKUSUyRlhvTmttT1FmSmFiN25aU1F0a1VEZGdKMHZ2bEpRdWdiOFBLcmdsRXclMkJhOW1YeWx6aVp1aU42Mnp2cDNpMlVZR3B4WTRSaDdk; cto_bidid=ad6Tvl9ucGJ2OWp1d1cxaHo4MHVBRkpwYVZVSGFQS3E2dTExbjVHQWVacG1VN3VNcHgxaUYweVdtUFFYZERySXp2eGFtUDlaNVBCT1hyOWZQTnFmWXZ6N2QwQSUzRCUzRA; _ga_M95P3TTWJZ=GS1.1.1690027757.1.1.1690028828.0.0.0; _ga=GA1.2.87244384.1640697683; _gat=1; _ga_M4YHF1JL8J=GS1.2.1690028045.1.1.1690028829.0.0.0'
}
#构建字典
temp = '_ga_7DSFGJNPL4=GS1.1.1689858308.1.1.1689858320.0.0.0; _ga_C2LFP3RFGH=GS1.1.1690027606.4.1.1690027935.0.0.0; .Cnblogs.AspNetCore.Cookies=CfDJ8DuWIYDefEVJtUW7VadsHY84qXnCo_l8ICXPKH_9HpPUUoLg0UexS-B3pggZ6-k4VcmwNfX8hC-_PTMWHEmcUrPrX-Z0HANU7_5m32oSqI9fyOFFXG_YwX2qeFt_iqobAYc2-QqQxBePBESquCkkTJO46Xm9uevpzSx6I_Q22Rq6JteIHuwkHSsQQwHeKRXB8dDs2K93OosWtC60LXuhgtQ_iEzUbmSvswC2IkvZoOgSWN4wEa1vz3JkPtFUKqSsIXDGFoF45PIbnsU176zLDVtMNFbGfLXIIXgr-N37l_caMDQ_jf83hMkcDUazIkS97lZI6DerpDFkThj-9kqJI8fUotjqVAV80bQViMduJa47W0ZUBpm_Y4uusk6xG41ADTKyxPT__bZ_wDdyGXS5npz6dD95YzCExRSW5vBPNNVGx-eisdo5aCnmt4NiH5vdtr9QyNXgfvvv2pn5yBgIyC-LAaMz2Pni1GI_wwkmdhtLMTjAEnyUdrYv9p2BAZb9cy1aVpi-aC1dO200N19-vwtVAJ9nQnJrknAIVDzuaIKkdwzd5UZhQn21_e0dLryXGulVCRoyRY2HTZmZUD9FqXQ; .CNBlogsCookie=DD77AEB0830213B71F3A677E8663D649FCE2668228EC3603F880DAA3C068B9581AF426158741EA3DC7A6AA7E74AF977FBC767B24F7C84CA69CBFC469A7245AB324F462F382A7399E576E99798F3C561C3B3383DD; _ga_3Q0DVSGN10=GS1.1.1690027762.6.1.1690028016.2.0.0; affinity=1690028046.3.308.352483|53e09caa9a86f4478a3056efca83512b; _gid=GA1.2.807364554.1690028045; __gads=ID=4bb592e3bd37fcaa:T=1689858308:RT=1690028818:S=ALNI_MZHDipyId3zfRXm-HxR1EkQm4MFOw; __gpi=UID=00000c22a50a8ca4:T=1689858308:RT=1690028818:S=ALNI_MaFUMjTbLjYEsOQEUnxSQsbf2aaFA; cto_bundle=Z6I1X19xJTJGVVVWV01zazlqVHJnZGxvZkxyREE0R0N3aGdvJTJGV0hLTEl6NjgwcTFLQ3E3blB6eE5ENnJKUSUyRlhvTmttT1FmSmFiN25aU1F0a1VEZGdKMHZ2bEpRdWdiOFBLcmdsRXclMkJhOW1YeWx6aVp1aU42Mnp2cDNpMlVZR3B4WTRSaDdk; cto_bidid=ad6Tvl9ucGJ2OWp1d1cxaHo4MHVBRkpwYVZVSGFQS3E2dTExbjVHQWVacG1VN3VNcHgxaUYweVdtUFFYZERySXp2eGFtUDlaNVBCT1hyOWZQTnFmWXZ6N2QwQSUzRCUzRA; _ga_M95P3TTWJZ=GS1.1.1690027757.1.1.1690028828.0.0.0; _ga=GA1.2.87244384.1640697683; _gat=1; _ga_M4YHF1JL8J=GS1.2.1690028045.1.1.1690028829.0.0.0'

#稳妥方案
cookies_list=temp.split('; ')
# print(cookies_list)
# temp1='_ga_7DSFGJNPL4=GS1.1.1689858308.1.1.1689858320.0.0.0'
# print(temp1.split('='))
# temp2=temp1.split('=')
cookies = {}
# print(temp2[0])
# print(temp2[-1])
# print(temp2[1])
for cookie in cookies_list:
cookies[cookie.split('=')[0]] = cookie.split('=')[-1]
print(cookies)
# response=requests.get(url,headers=headers)
response=requests.get(url,headers=headers,cookies=cookies)
with open('baidu6.html','wb') as f:
f.write(response.content)
print(response.url)

# response.encoding='utf8'
# print(response.text)
# print(response.encoding)
#
# print(len(response.content.decode()))
# print(response.content.decode())

# print(response.url)
# print(response.status_code)
# print(response.request.headers)
# print(response.headers)
# print(response.cookies)

标签:GS1.1,cookies,0.0,request,----,ga,print,response
From: https://www.cnblogs.com/dddzy/p/17574281.html

相关文章

  • 设计模式之状态模式
    假设我们正在开发一个网络下载器应用,该应用有不同的下载状态,包括未下载状态、下载中状态、下载完成状态和下载失败状态。我们可以使用状态模式来管理下载器的状态和行为。要是不用状态模式,这还真的就乱套了!看下代码吧。1//抽象状态类-下载状态2publicabstractclas......
  • 【持续更新】C 和 C++ 区别很大!
    一些容易被忽略的C与C++的重要区别头文件C标准库头文件名在C++中通常去除扩展名,并加上c前缀,如:stdio.h->cstdiostdlib.h->cstdlib其中一个重要的区别是后者保证与C库兼容的各个函数名可以在std命名空间中找到,但并不保证它们不存在于根命名空间中,这可能会引......
  • docker 一键安装脚本
    官方脚本(推荐)curl-fsSLhttps://get.docker.com|shcurl-L"https://github.com/docker/compose/releases/latest/download/docker-compose-$(uname-s)-$(uname-m)"-o/usr/local/bin/docker-composechmod+x/usr/local/bin/docker-compose查看docker版......
  • strlen/strcpy/strcat的模拟实现
    char*my_strcat(char*dest,constchar*src){ assert(dest!=NULL);//字符串要以‘\0’结束,目标空间要足够大,且可修改 assert(src!=NULL); char*ret=dest; //1,找到目的字符串的\0; while(*dest!='\0') { dest++; } //2,追加 while(*dest++=*src++) { ; } returnr......
  • C/C++航空客运订票系统[2023-07-22]
    C/C++航空客运订票系统[2023-07-22]航空客运订票系统1、每条航线所涉及的信息有:终点站名、航班号、飞机号、飞机周日(星期几)、乘员定额、余票量、订定票的客户名单(包括姓名、订票量、舱位等级1,2或3)以及等候替补的客户名单(包括姓名、所需数量)。2、系统能实现的操作和功能如下:(1)查......
  • Linux内核6.3生命周期结束
    在kernel.org网站上,Linux 6.3内核系列已经被标记为EOL(生命周期结束),这意味着它将不再支持错误和安全修复,告别Linux6.3内核系列的时刻已经到来。早些时候,知名的Linux内核维护者GregKroah-Hartman宣布发布Linux内核6.3.13,这是Linux6.3内核系列的第13次维护更新,这次更新带......
  • mysql workbench中文设置
    MySQLWorkbench中文设置导言MySQLWorkbench是一款常用的数据库管理工具,支持多种语言。本文将教会你如何在MySQLWorkbench中设置中文环境。流程下面是整个过程的步骤,以表格形式展示:步骤操作步骤一在MySQLWorkbench中打开“Edit”菜单步骤二选择“Prefer......
  • mysql workbench linux
    在Linux系统中安装MySQLWorkbench的步骤MySQLWorkbench是一个强大的数据库设计和管理工具,可以在Linux系统上安装和使用。下面是安装MySQLWorkbench的步骤和相应的代码示例。步骤概述步骤描述步骤1更新软件包列表步骤2安装MySQLWorkbench依赖步骤3下载......
  • mysql update死锁
    如何实现“mysqlupdate死锁”引言MySQL的死锁是指两个或多个事务相互等待对方释放资源而无法继续执行的情况。在开发中,我们需要了解如何实现死锁,以便更好地理解死锁产生的原因,并能够针对性地解决这类问题。本文将介绍如何使用MySQL实现一个简单的update死锁场景,并提供相应的代码......
  • mysql update 返回主键
    MySQLUpdate返回主键当我们在使用MySQL进行数据更新操作时,有时候需要获取被更新的数据的主键。MySQL提供了一种方法可以在更新数据时返回主键值,这对于某些特定的业务场景非常有用。为什么需要返回主键值?在某些情况下,我们需要在更新数据之后获取该数据的主键值。例如,假设我们有......