2026-01-12 21:03:47.824 | INFO     | __main__:crawl_recommend_jobs_main:1169 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:03:47.863 | INFO     | __main__:_init_client:415 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:03:47.905 | INFO     | __main__:crawl_recommend_jobs_main:1197 - 随机选择城市: 宁德 (110900)
2026-01-12 21:03:47.906 | INFO     | __main__:crawl_recommend_jobs_main:1201 - 随机选择工作类型: 产品VP (8802)
2026-01-12 21:03:47.906 | INFO     | __main__:crawl_recommend_jobs_main:1203 - 开始爬取推荐职位，最多 50 页
2026-01-12 21:03:47.906 | INFO     | __main__:crawl_multiple_pages:999 - ================================================================================
2026-01-12 21:03:47.906 | INFO     | __main__:crawl_multiple_pages:1000 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 宁德(110900) | 职能: 产品VP(8802)
2026-01-12 21:03:47.906 | INFO     | __main__:crawl_multiple_pages:1001 - ================================================================================
2026-01-12 21:03:47.906 | INFO     | __main__:crawl_multiple_pages:1004 - 
>>> 正在爬取第 1/50 页...
2026-01-12 21:03:47.906 | INFO     | __main__:_init_client:415 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:03:47.920 | INFO     | __main__:get_recommend_jobs:658 - 获取推荐职位: 页码=1, 页大小=20, 地区=110900, 工作类型=8802
2026-01-12 21:03:50.622 | WARNING  | __main__:_make_request:618 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:03:51.962 | WARNING  | __main__:_make_request:618 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:03:54.294 | WARNING  | __main__:_make_request:618 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:03:54.294 | ERROR    | __main__:_make_request:644 - 所有重试失败，请求终止
2026-01-12 21:03:55.106 | INFO     | __main__:_make_request:615 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768223027 status=200 resp_size=102688
2026-01-12 21:03:55.107 | INFO     | __main__:get_recommend_jobs:746 - 第 1 页成功获取 19 个职位（去重后: 19） | API返回totalCount: 19 (原始值: 19) | 地区: 宁德(110900) | 职能: 产品VP(8802)
2026-01-12 21:03:55.803 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170207797?api_key=51job&timestamp=1768223035 status=200 resp_size=4571
2026-01-12 21:03:56.340 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223035&companyId=10147208&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2775
2026-01-12 21:04:03.776 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162268166?api_key=51job&timestamp=1768223042 status=200 resp_size=5155
2026-01-12 21:04:04.296 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223043&companyId=9371380&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5199
2026-01-12 21:04:08.832 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160028248?api_key=51job&timestamp=1768223048 status=200 resp_size=5702
2026-01-12 21:04:09.138 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223048&companyId=9199595&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3460
2026-01-12 21:04:14.608 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163176884?api_key=51job&timestamp=1768223053 status=200 resp_size=4846
2026-01-12 21:04:14.990 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223054&companyId=9387161&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2586
2026-01-12 21:04:25.179 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169131017?api_key=51job&timestamp=1768223063 status=200 resp_size=5571
2026-01-12 21:04:25.504 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223065&companyId=10035656&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2776
2026-01-12 21:04:28.653 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163211074?api_key=51job&timestamp=1768223068 status=200 resp_size=5732
2026-01-12 21:04:28.883 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223068&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 21:04:37.694 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163631979?api_key=51job&timestamp=1768223076 status=200 resp_size=5727
2026-01-12 21:04:37.964 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223077&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 21:04:45.473 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169963090?api_key=51job&timestamp=1768223084 status=200 resp_size=6346
2026-01-12 21:04:45.963 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223085&companyId=10123807&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3647
2026-01-12 21:04:53.551 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168055185?api_key=51job&timestamp=1768223092 status=200 resp_size=6193
2026-01-12 21:04:53.801 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223093&companyId=9953019&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7167
2026-01-12 21:04:57.062 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167177837?api_key=51job&timestamp=1768223096 status=200 resp_size=5621
2026-01-12 21:04:57.431 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223097&companyId=9872690&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5235
2026-01-12 21:05:08.302 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170203701?api_key=51job&timestamp=1768223107 status=200 resp_size=5842
2026-01-12 21:05:09.344 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223108&companyId=10080902&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2578
2026-01-12 21:05:18.689 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161538185?api_key=51job&timestamp=1768223117 status=200 resp_size=6352
2026-01-12 21:05:18.984 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223118&companyId=9337943&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5056
2026-01-12 21:05:25.831 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170078237?api_key=51job&timestamp=1768223125 status=200 resp_size=5880
2026-01-12 21:05:26.035 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223125&companyId=10128402&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2626
2026-01-12 21:05:34.645 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167439224?api_key=51job&timestamp=1768223134 status=200 resp_size=6086
2026-01-12 21:05:34.819 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223134&companyId=9868960&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4728
2026-01-12 21:05:42.764 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086123?api_key=51job&timestamp=1768223141 status=200 resp_size=5330
2026-01-12 21:05:42.985 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223142&companyId=10090180&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2848
2026-01-12 21:05:47.866 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170134662?api_key=51job&timestamp=1768223147 status=200 resp_size=6400
2026-01-12 21:05:48.114 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223147&companyId=10139385&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2687
2026-01-12 21:05:53.491 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169819268?api_key=51job&timestamp=1768223153 status=200 resp_size=5477
2026-01-12 21:05:56.801 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223153&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
2026-01-12 21:05:59.025 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170051530?api_key=51job&timestamp=1768223158 status=200 resp_size=5134
2026-01-12 21:05:59.316 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223159&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 21:06:08.265 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169143272?api_key=51job&timestamp=1768223165 status=200 resp_size=6625
2026-01-12 21:06:08.574 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223168&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4814
2026-01-12 21:06:08.574 | INFO     | __main__:get_recommend_jobs:797 - 准备上报第 1 页数据，包含详细信息的数据条数: 19
2026-01-12 21:06:08.613 | INFO     | __main__:report_data:267 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-12 21:06:08.613 | INFO     | __main__:crawl_multiple_pages:1026 - 检测到API返回totalCount: 19 | 计算需要爬取: 1 页 (每页 20 条) | 预计最大数据: 20 条
2026-01-12 21:06:08.613 | INFO     | __main__:crawl_multiple_pages:1030 - 第 1 页获取到 19 个职位 | 累计: 19 个
2026-01-12 21:06:08.613 | INFO     | __main__:crawl_multiple_pages:1038 - 已获取所有数据 (19/19)，提前结束爬取
2026-01-12 21:06:08.613 | INFO     | __main__:crawl_multiple_pages:1055 - 
================================================================================
2026-01-12 21:06:08.613 | INFO     | __main__:crawl_multiple_pages:1056 - 爬取统计信息:
2026-01-12 21:06:08.614 | INFO     | __main__:crawl_multiple_pages:1057 -   总抓取数量: 19 条
2026-01-12 21:06:08.614 | INFO     | __main__:crawl_multiple_pages:1058 -   去重后数量: 19 条
2026-01-12 21:06:08.614 | INFO     | __main__:crawl_multiple_pages:1059 -   重复数量: 0 条
2026-01-12 21:06:08.614 | INFO     | __main__:crawl_multiple_pages:1060 -   API返回totalCount: 19 条
2026-01-12 21:06:08.614 | INFO     | __main__:crawl_multiple_pages:1061 -   实际爬取页数: 1 页
2026-01-12 21:06:08.614 | INFO     | __main__:crawl_multiple_pages:1062 -   地区: 宁德(110900)
2026-01-12 21:06:08.614 | INFO     | __main__:crawl_multiple_pages:1063 -   职能: 产品VP(8802)
2026-01-12 21:06:08.614 | INFO     | __main__:crawl_multiple_pages:1066 -   覆盖率: 100.00% (19/19)
2026-01-12 21:06:08.614 | INFO     | __main__:crawl_multiple_pages:1071 - ================================================================================

2026-01-12 21:06:08.614 | INFO     | __main__:save_crawl_stats:130 - 统计信息已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_stats.log
2026-01-12 21:06:08.614 | INFO     | __main__:crawl_multiple_pages:1085 - 职位记录已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_jobs_records.log (共 19 条记录)
2026-01-12 21:06:08.616 | INFO     | __main__:crawl_recommend_jobs_main:1215 - 推荐职位爬取完成！共找到 19 个职位
2026-01-12 21:06:08.616 | INFO     | __main__:close:1136 - httpx客户端已关闭
2026-01-12 21:06:16.938 | INFO     | __main__:crawl_recommend_jobs_main:1169 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:06:16.951 | INFO     | __main__:_init_client:415 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:06:16.979 | INFO     | __main__:crawl_recommend_jobs_main:1197 - 随机选择城市: 怀化 (191100)
2026-01-12 21:06:16.979 | INFO     | __main__:crawl_recommend_jobs_main:1201 - 随机选择工作类型: 水工 (3709)
2026-01-12 21:06:16.980 | INFO     | __main__:crawl_recommend_jobs_main:1203 - 开始爬取推荐职位，最多 50 页
2026-01-12 21:06:16.980 | INFO     | __main__:crawl_multiple_pages:999 - ================================================================================
2026-01-12 21:06:16.980 | INFO     | __main__:crawl_multiple_pages:1000 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 怀化(191100) | 职能: 水工(3709)
2026-01-12 21:06:16.980 | INFO     | __main__:crawl_multiple_pages:1001 - ================================================================================
2026-01-12 21:06:16.980 | INFO     | __main__:crawl_multiple_pages:1004 - 
>>> 正在爬取第 1/50 页...
2026-01-12 21:06:16.980 | INFO     | __main__:_init_client:415 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:06:16.992 | INFO     | __main__:get_recommend_jobs:658 - 获取推荐职位: 页码=1, 页大小=20, 地区=191100, 工作类型=3709
2026-01-12 21:06:19.043 | WARNING  | __main__:_make_request:618 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:06:20.339 | WARNING  | __main__:_make_request:618 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:06:22.619 | WARNING  | __main__:_make_request:618 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:06:22.619 | ERROR    | __main__:_make_request:644 - 所有重试失败，请求终止
2026-01-12 21:06:23.298 | INFO     | __main__:_make_request:615 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768223176 status=200 resp_size=104016
2026-01-12 21:06:23.298 | INFO     | __main__:get_recommend_jobs:746 - 第 1 页成功获取 18 个职位（去重后: 18） | API返回totalCount: 18 (原始值: 18) | 地区: 怀化(191100) | 职能: 水工(3709)
2026-01-12 21:06:23.669 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168121261?api_key=51job&timestamp=1768223183 status=200 resp_size=6064
2026-01-12 21:06:23.941 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223183&companyId=9435366&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3714
2026-01-12 21:06:29.987 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164269314?api_key=51job&timestamp=1768223189 status=200 resp_size=6959
2026-01-12 21:06:30.176 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223189&companyId=7640642&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3797
2026-01-12 21:06:34.335 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166526878?api_key=51job&timestamp=1768223194 status=200 resp_size=5515
2026-01-12 21:06:34.523 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223194&companyId=9816763&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-12 21:06:44.315 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162204848?api_key=51job&timestamp=1768223203 status=200 resp_size=5676
2026-01-12 21:06:45.724 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223204&companyId=9371380&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5199
2026-01-12 21:06:58.836 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170162517?api_key=51job&timestamp=1768223214 status=200 resp_size=5288
2026-01-12 21:07:00.383 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223218&companyId=4206092&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6265
2026-01-12 21:07:10.882 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159994837?api_key=51job&timestamp=1768223229 status=200 resp_size=5873
2026-01-12 21:07:11.084 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223230&companyId=9199595&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3460
2026-01-12 21:07:15.153 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170011953?api_key=51job&timestamp=1768223234 status=200 resp_size=7612
2026-01-12 21:07:15.479 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223235&companyId=8199797&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9586
2026-01-12 21:07:22.208 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170162215?api_key=51job&timestamp=1768223241 status=200 resp_size=5022
2026-01-12 21:07:22.534 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223242&companyId=4206092&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6265
2026-01-12 21:07:26.613 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170188999?api_key=51job&timestamp=1768223246 status=200 resp_size=5531
2026-01-12 21:07:26.858 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223246&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
2026-01-12 21:07:38.049 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168411165?api_key=51job&timestamp=1768223256 status=200 resp_size=7227
2026-01-12 21:07:38.275 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223258&companyId=6966653&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3852
2026-01-12 21:07:44.662 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169256770?api_key=51job&timestamp=1768223263 status=200 resp_size=6358
2026-01-12 21:07:45.051 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223264&companyId=10028121&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2934
2026-01-12 21:07:54.763 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161588035?api_key=51job&timestamp=1768223273 status=200 resp_size=6359
2026-01-12 21:07:55.029 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223274&companyId=9337943&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5056
2026-01-12 21:08:03.662 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168742494?api_key=51job&timestamp=1768223282 status=200 resp_size=6510
2026-01-12 21:08:03.930 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223283&companyId=9947213&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7021
2026-01-12 21:08:06.856 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168146233?api_key=51job&timestamp=1768223286 status=200 resp_size=6169
2026-01-12 21:08:07.215 | INFO     | __main__:_make_request:615 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223286&companyId=9915300&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2916
2026-01-12 21:08:13.687 | INFO     | __main__:crawl_recommend_jobs_main:1222 - 用户中断推荐职位爬取
2026-01-12 21:08:13.688 | INFO     | __main__:close:1136 - httpx客户端已关闭
2026-01-12 21:11:48.859 | INFO     | __main__:crawl_recommend_jobs_main:1170 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:11:48.969 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:11:59.032 | INFO     | __main__:crawl_recommend_jobs_main:1198 - 随机选择城市: 拉萨 (300200)
2026-01-12 21:11:59.034 | INFO     | __main__:crawl_recommend_jobs_main:1202 - 随机选择工作类型: 施工开料工 (2143)
2026-01-12 21:11:59.034 | INFO     | __main__:crawl_recommend_jobs_main:1204 - 开始爬取推荐职位，最多 50 页
2026-01-12 21:11:59.034 | INFO     | __main__:crawl_multiple_pages:1000 - ================================================================================
2026-01-12 21:11:59.035 | INFO     | __main__:crawl_multiple_pages:1001 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 拉萨(300200) | 职能: 施工开料工(2143)
2026-01-12 21:11:59.035 | INFO     | __main__:crawl_multiple_pages:1002 - ================================================================================
2026-01-12 21:11:59.036 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 1/50 页...
2026-01-12 21:11:59.036 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:11:59.056 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=1, 页大小=20, 地区=300200, 工作类型=2143
2026-01-12 21:12:00.388 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:12:01.682 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:12:03.919 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:12:03.919 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:12:04.341 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768223519 status=200 resp_size=65878
2026-01-12 21:12:04.343 | INFO     | __main__:get_recommend_jobs:747 - 第 1 页成功获取 12 个职位（去重后: 12） | API返回totalCount: 12 (原始值: 12) | 地区: 拉萨(300200) | 职能: 施工开料工(2143)
2026-01-12 21:12:04.706 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170136608?api_key=51job&timestamp=1768223524 status=200 resp_size=4480
2026-01-12 21:12:04.972 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223524&companyId=10141099&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2857
2026-01-12 21:12:13.371 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164635818?api_key=51job&timestamp=1768223532 status=200 resp_size=6238
2026-01-12 21:12:13.624 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223533&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4814
2026-01-12 21:12:16.007 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166120581?api_key=51job&timestamp=1768223535 status=200 resp_size=5609
2026-01-12 21:12:16.284 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223536&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-12 21:12:23.312 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163239608?api_key=51job&timestamp=1768223542 status=200 resp_size=4503
2026-01-12 21:12:23.502 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223543&companyId=9383822&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2691
2026-01-12 21:12:25.586 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167459585?api_key=51job&timestamp=1768223545 status=200 resp_size=5629
2026-01-12 21:12:25.764 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223545&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 21:12:35.392 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163193190?api_key=51job&timestamp=1768223554 status=200 resp_size=6285
2026-01-12 21:12:35.781 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223555&companyId=9490549&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2655
2026-01-12 21:12:38.806 | INFO     | __main__:crawl_recommend_jobs_main:1223 - 用户中断推荐职位爬取
2026-01-12 21:12:38.806 | INFO     | __main__:close:1137 - httpx客户端已关闭
2026-01-12 21:12:40.891 | INFO     | __main__:crawl_recommend_jobs_main:1170 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:12:40.937 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:12:40.970 | INFO     | __main__:crawl_recommend_jobs_main:1198 - 随机选择城市: 济宁 (120900)
2026-01-12 21:12:40.970 | INFO     | __main__:crawl_recommend_jobs_main:1202 - 随机选择工作类型: 前端开发 (A0JU)
2026-01-12 21:12:40.970 | INFO     | __main__:crawl_recommend_jobs_main:1204 - 开始爬取推荐职位，最多 50 页
2026-01-12 21:12:40.971 | INFO     | __main__:crawl_multiple_pages:1000 - ================================================================================
2026-01-12 21:12:40.971 | INFO     | __main__:crawl_multiple_pages:1001 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 济宁(120900) | 职能: 前端开发(A0JU)
2026-01-12 21:12:40.971 | INFO     | __main__:crawl_multiple_pages:1002 - ================================================================================
2026-01-12 21:12:40.971 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 1/50 页...
2026-01-12 21:12:40.971 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:12:40.984 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=1, 页大小=20, 地区=120900, 工作类型=A0JU
2026-01-12 21:12:42.104 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:12:43.015 | INFO     | __main__:crawl_recommend_jobs_main:1223 - 用户中断推荐职位爬取
2026-01-12 21:12:43.015 | INFO     | __main__:close:1137 - httpx客户端已关闭
2026-01-12 21:12:47.510 | INFO     | __main__:crawl_recommend_jobs_main:1170 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:12:47.551 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:12:47.577 | INFO     | __main__:crawl_recommend_jobs_main:1198 - 随机选择城市: 日照 (121200)
2026-01-12 21:12:47.578 | INFO     | __main__:crawl_recommend_jobs_main:1202 - 随机选择工作类型: 建筑设计师 (6905)
2026-01-12 21:12:47.578 | INFO     | __main__:crawl_recommend_jobs_main:1204 - 开始爬取推荐职位，最多 50 页
2026-01-12 21:12:47.578 | INFO     | __main__:crawl_multiple_pages:1000 - ================================================================================
2026-01-12 21:12:47.578 | INFO     | __main__:crawl_multiple_pages:1001 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 日照(121200) | 职能: 建筑设计师(6905)
2026-01-12 21:12:47.578 | INFO     | __main__:crawl_multiple_pages:1002 - ================================================================================
2026-01-12 21:12:47.578 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 1/50 页...
2026-01-12 21:12:47.578 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:12:47.592 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=1, 页大小=20, 地区=121200, 工作类型=6905
2026-01-12 21:12:48.546 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:12:49.808 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:12:52.011 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:12:52.012 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:12:52.489 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768223567 status=200 resp_size=95121
2026-01-12 21:12:52.490 | INFO     | __main__:get_recommend_jobs:747 - 第 1 页成功获取 17 个职位（去重后: 17） | API返回totalCount: 17 (原始值: 17) | 地区: 日照(121200) | 职能: 建筑设计师(6905)
2026-01-12 21:12:52.745 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164335478?api_key=51job&timestamp=1768223572 status=200 resp_size=5642
2026-01-12 21:12:53.006 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223572&companyId=143102&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7176
2026-01-12 21:12:54.520 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164269124?api_key=51job&timestamp=1768223574 status=200 resp_size=6981
2026-01-12 21:12:54.756 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223574&companyId=7640642&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3797
2026-01-12 21:12:58.508 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166514313?api_key=51job&timestamp=1768223578 status=200 resp_size=5515
2026-01-12 21:12:58.734 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223578&companyId=9816763&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-12 21:13:05.712 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159347759?api_key=51job&timestamp=1768223584 status=200 resp_size=5479
2026-01-12 21:13:05.891 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223585&companyId=9157456&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2678
2026-01-12 21:13:08.059 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169680079?api_key=51job&timestamp=1768223587 status=200 resp_size=6040
2026-01-12 21:13:08.615 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223588&companyId=10096208&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3018
2026-01-12 21:13:15.399 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162100384?api_key=51job&timestamp=1768223594 status=200 resp_size=5396
2026-01-12 21:13:15.621 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223595&companyId=9390971&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2589
2026-01-12 21:13:27.277 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163211080?api_key=51job&timestamp=1768223604 status=200 resp_size=5737
2026-01-12 21:13:27.721 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223607&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 21:13:33.082 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170048113?api_key=51job&timestamp=1768223612 status=200 resp_size=6500
2026-01-12 21:13:33.586 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223613&companyId=9953821&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2612
2026-01-12 21:13:42.325 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161664886?api_key=51job&timestamp=1768223621 status=200 resp_size=6351
2026-01-12 21:13:42.518 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223622&companyId=9337943&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5056
2026-01-12 21:13:51.187 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167613542?api_key=51job&timestamp=1768223629 status=200 resp_size=6137
2026-01-12 21:13:51.403 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223631&companyId=9868960&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4728
2026-01-12 21:13:55.043 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170045976?api_key=51job&timestamp=1768223634 status=200 resp_size=6068
2026-01-12 21:13:55.241 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223635&companyId=10116929&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6111
2026-01-12 21:14:04.218 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168376576?api_key=51job&timestamp=1768223643 status=200 resp_size=7232
2026-01-12 21:14:05.490 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223644&companyId=6966653&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3852
2026-01-12 21:14:09.192 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169819741?api_key=51job&timestamp=1768223648 status=200 resp_size=5524
2026-01-12 21:14:09.410 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223649&companyId=9987348&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3329
2026-01-12 21:14:18.799 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169564012?api_key=51job&timestamp=1768223657 status=200 resp_size=5556
2026-01-12 21:14:19.241 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223658&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
2026-01-12 21:14:29.384 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166084163?api_key=51job&timestamp=1768223668 status=200 resp_size=5509
2026-01-12 21:14:29.640 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223669&companyId=9788564&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5265
2026-01-12 21:14:32.495 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170063488?api_key=51job&timestamp=1768223672 status=200 resp_size=5199
2026-01-12 21:14:33.892 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223672&companyId=10133483&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3132
2026-01-12 21:14:36.113 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169354979?api_key=51job&timestamp=1768223675 status=200 resp_size=6623
2026-01-12 21:14:36.424 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223676&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4814
2026-01-12 21:14:36.424 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 1 页数据，包含详细信息的数据条数: 17
2026-01-12 21:14:36.472 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 17, 响应大小: 113 字节
2026-01-12 21:14:36.472 | INFO     | __main__:crawl_multiple_pages:1027 - 检测到API返回totalCount: 17 | 计算需要爬取: 1 页 (每页 20 条) | 预计最大数据: 20 条
2026-01-12 21:14:36.472 | INFO     | __main__:crawl_multiple_pages:1031 - 第 1 页获取到 17 个职位 | 累计: 17 个
2026-01-12 21:14:36.472 | INFO     | __main__:crawl_multiple_pages:1039 - 已获取所有数据 (17/17)，提前结束爬取
2026-01-12 21:14:36.472 | INFO     | __main__:crawl_multiple_pages:1056 - 
================================================================================
2026-01-12 21:14:36.473 | INFO     | __main__:crawl_multiple_pages:1057 - 爬取统计信息:
2026-01-12 21:14:36.473 | INFO     | __main__:crawl_multiple_pages:1058 -   总抓取数量: 17 条
2026-01-12 21:14:36.473 | INFO     | __main__:crawl_multiple_pages:1059 -   去重后数量: 17 条
2026-01-12 21:14:36.473 | INFO     | __main__:crawl_multiple_pages:1060 -   重复数量: 0 条
2026-01-12 21:14:36.473 | INFO     | __main__:crawl_multiple_pages:1061 -   API返回totalCount: 17 条
2026-01-12 21:14:36.474 | INFO     | __main__:crawl_multiple_pages:1062 -   实际爬取页数: 1 页
2026-01-12 21:14:36.474 | INFO     | __main__:crawl_multiple_pages:1063 -   地区: 日照(121200)
2026-01-12 21:14:36.474 | INFO     | __main__:crawl_multiple_pages:1064 -   职能: 建筑设计师(6905)
2026-01-12 21:14:36.474 | INFO     | __main__:crawl_multiple_pages:1067 -   覆盖率: 100.00% (17/17)
2026-01-12 21:14:36.474 | INFO     | __main__:crawl_multiple_pages:1072 - ================================================================================

2026-01-12 21:14:36.475 | INFO     | __main__:save_crawl_stats:131 - 统计信息已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_stats.log
2026-01-12 21:14:36.475 | INFO     | __main__:crawl_multiple_pages:1086 - 职位记录已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_jobs_records.log (共 17 条记录)
2026-01-12 21:14:36.475 | INFO     | __main__:crawl_recommend_jobs_main:1216 - 推荐职位爬取完成！共找到 17 个职位
2026-01-12 21:14:36.475 | INFO     | __main__:close:1137 - httpx客户端已关闭
2026-01-12 21:14:45.934 | INFO     | __main__:crawl_recommend_jobs_main:1170 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:14:45.947 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:14:45.978 | INFO     | __main__:crawl_recommend_jobs_main:1198 - 随机选择城市: 丹东 (230800)
2026-01-12 21:14:45.978 | INFO     | __main__:crawl_recommend_jobs_main:1202 - 随机选择工作类型: 业务拓展经理/主管 (0232)
2026-01-12 21:14:45.978 | INFO     | __main__:crawl_recommend_jobs_main:1204 - 开始爬取推荐职位，最多 50 页
2026-01-12 21:14:45.978 | INFO     | __main__:crawl_multiple_pages:1000 - ================================================================================
2026-01-12 21:14:45.979 | INFO     | __main__:crawl_multiple_pages:1001 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 丹东(230800) | 职能: 业务拓展经理/主管(0232)
2026-01-12 21:14:45.979 | INFO     | __main__:crawl_multiple_pages:1002 - ================================================================================
2026-01-12 21:14:45.979 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 1/50 页...
2026-01-12 21:14:45.979 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:14:45.990 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=1, 页大小=20, 地区=230800, 工作类型=0232
2026-01-12 21:14:46.653 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:14:47.799 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:14:49.937 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:14:49.937 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:14:50.249 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768223685 status=200 resp_size=64748
2026-01-12 21:14:50.250 | INFO     | __main__:get_recommend_jobs:747 - 第 1 页成功获取 12 个职位（去重后: 12） | API返回totalCount: 12 (原始值: 12) | 地区: 丹东(230800) | 职能: 业务拓展经理/主管(0232)
2026-01-12 21:14:50.447 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170085916?api_key=51job&timestamp=1768223690 status=200 resp_size=5351
2026-01-12 21:14:50.627 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223690&companyId=10090180&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2848
2026-01-12 21:14:55.656 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162439445?api_key=51job&timestamp=1768223695 status=200 resp_size=5591
2026-01-12 21:14:55.841 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223695&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-12 21:15:06.749 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166526953?api_key=51job&timestamp=1768223704 status=200 resp_size=5515
2026-01-12 21:15:07.188 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223706&companyId=9816763&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-12 21:15:15.548 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160061497?api_key=51job&timestamp=1768223714 status=200 resp_size=6058
2026-01-12 21:15:15.801 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223715&companyId=9210539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3106
2026-01-12 21:15:19.322 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169236588?api_key=51job&timestamp=1768223718 status=200 resp_size=5653
2026-01-12 21:15:19.580 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223719&companyId=10054286&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2900
2026-01-12 21:15:30.338 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164269401?api_key=51job&timestamp=1768223728 status=200 resp_size=6979
2026-01-12 21:15:30.870 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223730&companyId=7640642&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3797
2026-01-12 21:15:35.622 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168413335?api_key=51job&timestamp=1768223734 status=200 resp_size=7227
2026-01-12 21:15:36.259 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223735&companyId=6966653&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3852
2026-01-12 21:15:46.173 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166256140?api_key=51job&timestamp=1768223745 status=200 resp_size=6086
2026-01-12 21:15:46.365 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223746&companyId=9783603&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3141
2026-01-12 21:15:54.679 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161633240?api_key=51job&timestamp=1768223753 status=200 resp_size=6347
2026-01-12 21:15:54.876 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223754&companyId=9337943&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5056
2026-01-12 21:15:57.329 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170228247?api_key=51job&timestamp=1768223757 status=200 resp_size=6581
2026-01-12 21:15:57.531 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223757&companyId=8965902&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7240
2026-01-12 21:16:07.676 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169947494?api_key=51job&timestamp=1768223766 status=200 resp_size=4432
2026-01-12 21:16:07.873 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223767&companyId=10122481&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2992
2026-01-12 21:16:16.313 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169873457?api_key=51job&timestamp=1768223775 status=200 resp_size=4345
2026-01-12 21:16:16.594 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223776&companyId=10114808&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-12 21:16:16.594 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 1 页数据，包含详细信息的数据条数: 12
2026-01-12 21:16:16.640 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 12, 响应大小: 113 字节
2026-01-12 21:16:16.641 | INFO     | __main__:crawl_multiple_pages:1027 - 检测到API返回totalCount: 12 | 计算需要爬取: 1 页 (每页 20 条) | 预计最大数据: 20 条
2026-01-12 21:16:16.641 | INFO     | __main__:crawl_multiple_pages:1031 - 第 1 页获取到 12 个职位 | 累计: 12 个
2026-01-12 21:16:16.641 | INFO     | __main__:crawl_multiple_pages:1039 - 已获取所有数据 (12/12)，提前结束爬取
2026-01-12 21:16:16.642 | INFO     | __main__:crawl_multiple_pages:1056 - 
================================================================================
2026-01-12 21:16:16.642 | INFO     | __main__:crawl_multiple_pages:1057 - 爬取统计信息:
2026-01-12 21:16:16.642 | INFO     | __main__:crawl_multiple_pages:1058 -   总抓取数量: 12 条
2026-01-12 21:16:16.642 | INFO     | __main__:crawl_multiple_pages:1059 -   去重后数量: 12 条
2026-01-12 21:16:16.642 | INFO     | __main__:crawl_multiple_pages:1060 -   重复数量: 0 条
2026-01-12 21:16:16.643 | INFO     | __main__:crawl_multiple_pages:1061 -   API返回totalCount: 12 条
2026-01-12 21:16:16.643 | INFO     | __main__:crawl_multiple_pages:1062 -   实际爬取页数: 1 页
2026-01-12 21:16:16.643 | INFO     | __main__:crawl_multiple_pages:1063 -   地区: 丹东(230800)
2026-01-12 21:16:16.643 | INFO     | __main__:crawl_multiple_pages:1064 -   职能: 业务拓展经理/主管(0232)
2026-01-12 21:16:16.643 | INFO     | __main__:crawl_multiple_pages:1067 -   覆盖率: 100.00% (12/12)
2026-01-12 21:16:16.643 | INFO     | __main__:crawl_multiple_pages:1072 - ================================================================================

2026-01-12 21:16:16.644 | INFO     | __main__:save_crawl_stats:131 - 统计信息已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_stats.log
2026-01-12 21:16:16.645 | INFO     | __main__:crawl_multiple_pages:1086 - 职位记录已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_jobs_records.log (共 12 条记录)
2026-01-12 21:16:16.645 | INFO     | __main__:crawl_recommend_jobs_main:1216 - 推荐职位爬取完成！共找到 12 个职位
2026-01-12 21:16:16.645 | INFO     | __main__:close:1137 - httpx客户端已关闭
2026-01-12 21:16:17.696 | INFO     | __main__:crawl_recommend_jobs_main:1170 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:16:17.706 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:16:17.727 | INFO     | __main__:crawl_recommend_jobs_main:1198 - 随机选择城市: 大连 (230300)
2026-01-12 21:16:17.728 | INFO     | __main__:crawl_recommend_jobs_main:1202 - 随机选择工作类型: 挡车工 (3825)
2026-01-12 21:16:17.728 | INFO     | __main__:crawl_recommend_jobs_main:1204 - 开始爬取推荐职位，最多 50 页
2026-01-12 21:16:17.729 | INFO     | __main__:crawl_multiple_pages:1000 - ================================================================================
2026-01-12 21:16:17.729 | INFO     | __main__:crawl_multiple_pages:1001 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 大连(230300) | 职能: 挡车工(3825)
2026-01-12 21:16:17.729 | INFO     | __main__:crawl_multiple_pages:1002 - ================================================================================
2026-01-12 21:16:17.729 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 1/50 页...
2026-01-12 21:16:17.729 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:16:17.741 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=1, 页大小=20, 地区=230300, 工作类型=3825
2026-01-12 21:16:19.879 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:16:21.091 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:16:23.300 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:16:23.300 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:16:24.109 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768223777 status=200 resp_size=107661
2026-01-12 21:16:24.109 | INFO     | __main__:get_recommend_jobs:747 - 第 1 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 184 (原始值: 184) | 地区: 大连(230300) | 职能: 挡车工(3825)
2026-01-12 21:16:24.355 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168691224?api_key=51job&timestamp=1768223784 status=200 resp_size=7222
2026-01-12 21:16:24.603 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223784&companyId=9984941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4680
2026-01-12 21:16:32.399 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164269404?api_key=51job&timestamp=1768223791 status=200 resp_size=7001
2026-01-12 21:16:32.633 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223792&companyId=7640642&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3797
2026-01-12 21:16:39.771 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160371882?api_key=51job&timestamp=1768223798 status=200 resp_size=5240
2026-01-12 21:16:39.967 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223799&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-12 21:16:46.429 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160372430?api_key=51job&timestamp=1768223805 status=200 resp_size=5645
2026-01-12 21:16:46.618 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223806&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-12 21:16:50.891 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170134816?api_key=51job&timestamp=1768223810 status=200 resp_size=4887
2026-01-12 21:16:51.111 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223810&companyId=10140823&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3057
2026-01-12 21:16:54.940 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370360?api_key=51job&timestamp=1768223814 status=200 resp_size=5552
2026-01-12 21:16:55.129 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223814&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-12 21:17:05.219 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163667206?api_key=51job&timestamp=1768223820 status=200 resp_size=5084
2026-01-12 21:17:05.801 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223825&companyId=9431870&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2605
2026-01-12 21:17:08.370 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164791637?api_key=51job&timestamp=1768223827 status=200 resp_size=6265
2026-01-12 21:17:09.394 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223828&companyId=9435366&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3714
2026-01-12 21:17:14.619 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161633211?api_key=51job&timestamp=1768223833 status=200 resp_size=6370
2026-01-12 21:17:15.642 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223834&companyId=9337943&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5056
2026-01-12 21:17:27.416 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370120?api_key=51job&timestamp=1768223844 status=200 resp_size=5619
2026-01-12 21:17:28.023 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223847&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-12 21:17:32.013 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165020146?api_key=51job&timestamp=1768223851 status=200 resp_size=6026
2026-01-12 21:17:32.812 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223852&companyId=9435366&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3714
2026-01-12 21:17:39.876 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167426160?api_key=51job&timestamp=1768223858 status=200 resp_size=5522
2026-01-12 21:17:40.137 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223859&companyId=9856387&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3703
2026-01-12 21:17:49.432 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126795?api_key=51job&timestamp=1768223867 status=200 resp_size=6292
2026-01-12 21:17:49.753 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223869&companyId=10139549&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2868
2026-01-12 21:17:58.246 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160081733?api_key=51job&timestamp=1768223877 status=200 resp_size=6127
2026-01-12 21:17:58.576 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223878&companyId=9210539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3106
2026-01-12 21:18:01.770 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166526989?api_key=51job&timestamp=1768223881 status=200 resp_size=5515
2026-01-12 21:18:02.041 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223881&companyId=9816763&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-12 21:18:09.162 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158370416?api_key=51job&timestamp=1768223888 status=200 resp_size=5730
2026-01-12 21:18:09.377 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223889&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-12 21:18:17.850 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170107374?api_key=51job&timestamp=1768223896 status=200 resp_size=5788
2026-01-12 21:18:19.104 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223897&companyId=10035656&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2776
2026-01-12 21:18:29.538 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157485381?api_key=51job&timestamp=1768223907 status=200 resp_size=5712
2026-01-12 21:18:29.981 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223909&companyId=8975951&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2671
2026-01-12 21:18:39.315 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/154190333?api_key=51job&timestamp=1768223918 status=200 resp_size=4682
2026-01-12 21:18:39.608 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223919&companyId=8090601&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2701
2026-01-12 21:18:41.028 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166382946?api_key=51job&timestamp=1768223920 status=200 resp_size=6251
2026-01-12 21:18:41.290 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223921&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-12 21:18:41.290 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 1 页数据，包含详细信息的数据条数: 20
2026-01-12 21:18:41.342 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 21:18:41.342 | INFO     | __main__:crawl_multiple_pages:1027 - 检测到API返回totalCount: 184 | 计算需要爬取: 10 页 (每页 20 条) | 预计最大数据: 200 条
2026-01-12 21:18:41.342 | INFO     | __main__:crawl_multiple_pages:1031 - 第 1 页获取到 20 个职位 | 累计: 20 个
2026-01-12 21:18:48.004 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 6.66 秒后继续...
2026-01-12 21:18:48.004 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 2/10 页...
2026-01-12 21:18:48.005 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:18:48.026 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=2, 页大小=20, 地区=230300, 工作类型=3825
2026-01-12 21:18:49.013 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:18:50.250 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:18:52.486 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:18:52.488 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:18:53.036 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768223928 status=200 resp_size=111868
2026-01-12 21:18:53.036 | INFO     | __main__:get_recommend_jobs:747 - 第 2 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 184 (原始值: 184) | 地区: 大连(230300) | 职能: 挡车工(3825)
2026-01-12 21:18:54.429 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167284969?api_key=51job&timestamp=1768223933 status=200 resp_size=6600
2026-01-12 21:18:54.712 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223934&companyId=143102&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7176
2026-01-12 21:19:02.815 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164840538?api_key=51job&timestamp=1768223941 status=200 resp_size=6356
2026-01-12 21:19:03.013 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223942&companyId=9680875&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4102
2026-01-12 21:19:07.658 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163859822?api_key=51job&timestamp=1768223947 status=200 resp_size=6117
2026-01-12 21:19:07.952 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223947&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 21:19:10.058 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166179466?api_key=51job&timestamp=1768223949 status=200 resp_size=5613
2026-01-12 21:19:10.273 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223950&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-12 21:19:19.466 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170134039?api_key=51job&timestamp=1768223957 status=200 resp_size=6951
2026-01-12 21:19:20.215 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223959&companyId=3090589&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6574
2026-01-12 21:19:27.496 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166913879?api_key=51job&timestamp=1768223965 status=200 resp_size=5156
2026-01-12 21:19:27.729 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223967&companyId=9496587&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2726
2026-01-12 21:19:31.926 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162791900?api_key=51job&timestamp=1768223971 status=200 resp_size=5095
2026-01-12 21:19:32.181 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223971&companyId=9442657&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2602
2026-01-12 21:19:40.105 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954413?api_key=51job&timestamp=1768223978 status=200 resp_size=5930
2026-01-12 21:19:40.448 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223980&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 21:19:45.605 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165491987?api_key=51job&timestamp=1768223985 status=200 resp_size=6129
2026-01-12 21:19:45.866 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223985&companyId=9732609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2706
2026-01-12 21:19:54.397 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166116057?api_key=51job&timestamp=1768223993 status=200 resp_size=6206
2026-01-12 21:19:54.609 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768223994&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-12 21:20:04.533 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165619180?api_key=51job&timestamp=1768224003 status=200 resp_size=6240
2026-01-12 21:20:04.904 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224004&companyId=9680875&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4102
2026-01-12 21:20:14.441 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161789556?api_key=51job&timestamp=1768224013 status=200 resp_size=5206
2026-01-12 21:20:14.645 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224014&companyId=9366134&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3620
2026-01-12 21:20:22.259 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168263818?api_key=51job&timestamp=1768224021 status=200 resp_size=5648
2026-01-12 21:20:22.537 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224022&companyId=9730476&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3024
2026-01-12 21:20:27.627 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041140?api_key=51job&timestamp=1768224027 status=200 resp_size=5806
2026-01-12 21:20:27.931 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224027&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 21:20:37.923 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165893672?api_key=51job&timestamp=1768224036 status=200 resp_size=5370
2026-01-12 21:20:39.278 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224037&companyId=9771350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6796
2026-01-12 21:20:43.672 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164110649?api_key=51job&timestamp=1768224043 status=200 resp_size=5428
2026-01-12 21:20:43.923 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224043&companyId=9548336&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4229
2026-01-12 21:20:55.136 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166956190?api_key=51job&timestamp=1768224053 status=200 resp_size=13621
2026-01-12 21:20:55.498 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224055&companyId=4313557&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6990
2026-01-12 21:21:04.272 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160490611?api_key=51job&timestamp=1768224063 status=200 resp_size=5031
2026-01-12 21:21:04.467 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224064&companyId=9247001&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2620
2026-01-12 21:21:06.528 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954599?api_key=51job&timestamp=1768224066 status=200 resp_size=5642
2026-01-12 21:21:06.706 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224066&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 21:21:09.440 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165192496?api_key=51job&timestamp=1768224069 status=200 resp_size=6318
2026-01-12 21:21:09.613 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224069&companyId=9680875&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4102
2026-01-12 21:21:09.613 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 2 页数据，包含详细信息的数据条数: 20
2026-01-12 21:21:18.613 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 21:21:18.614 | INFO     | __main__:crawl_multiple_pages:1031 - 第 2 页获取到 20 个职位 | 累计: 40 个
2026-01-12 21:21:26.968 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 8.35 秒后继续...
2026-01-12 21:21:26.968 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 3/10 页...
2026-01-12 21:21:26.968 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:21:27.000 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=3, 页大小=20, 地区=230300, 工作类型=3825
2026-01-12 21:21:28.704 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:21:29.883 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:21:32.075 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:21:32.075 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:21:32.557 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768224087 status=200 resp_size=116432
2026-01-12 21:21:32.558 | INFO     | __main__:get_recommend_jobs:747 - 第 3 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 184 (原始值: 184) | 地区: 大连(230300) | 职能: 挡车工(3825)
2026-01-12 21:21:32.771 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/138250877?api_key=51job&timestamp=1768224092 status=200 resp_size=5184
2026-01-12 21:21:33.006 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224092&companyId=2335820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8291
2026-01-12 21:21:42.323 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166633851?api_key=51job&timestamp=1768224101 status=200 resp_size=4918
2026-01-12 21:21:42.574 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224102&companyId=9442657&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2602
2026-01-12 21:21:52.036 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160078573?api_key=51job&timestamp=1768224111 status=200 resp_size=5609
2026-01-12 21:21:52.233 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224112&companyId=9199595&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3460
2026-01-12 21:21:54.893 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165124965?api_key=51job&timestamp=1768224114 status=200 resp_size=5278
2026-01-12 21:21:55.086 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224114&companyId=8635625&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2799
2026-01-12 21:22:03.526 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170049037?api_key=51job&timestamp=1768224122 status=200 resp_size=6653
2026-01-12 21:22:03.872 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224123&companyId=9882618&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3684
2026-01-12 21:22:14.780 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163718469?api_key=51job&timestamp=1768224132 status=200 resp_size=5618
2026-01-12 21:22:15.071 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224134&companyId=9539124&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4639
2026-01-12 21:22:25.119 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165124664?api_key=51job&timestamp=1768224144 status=200 resp_size=5257
2026-01-12 21:22:25.446 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224145&companyId=8635625&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2799
2026-01-12 21:22:34.974 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166506615?api_key=51job&timestamp=1768224154 status=200 resp_size=6192
2026-01-12 21:22:35.160 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224154&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4814
2026-01-12 21:22:37.597 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169906447?api_key=51job&timestamp=1768224157 status=200 resp_size=5708
2026-01-12 21:22:37.776 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224157&companyId=7983970&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5833
2026-01-12 21:22:42.708 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163631944?api_key=51job&timestamp=1768224162 status=200 resp_size=5731
2026-01-12 21:22:42.907 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224162&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 21:22:54.522 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164635779?api_key=51job&timestamp=1768224172 status=200 resp_size=6209
2026-01-12 21:22:54.826 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224174&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4814
2026-01-12 21:23:03.486 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166033124?api_key=51job&timestamp=1768224182 status=200 resp_size=5940
2026-01-12 21:23:04.126 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224183&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 21:23:09.172 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168817188?api_key=51job&timestamp=1768224188 status=200 resp_size=13664
2026-01-12 21:23:10.846 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224189&companyId=4313557&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6990
2026-01-12 21:23:21.296 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163080629?api_key=51job&timestamp=1768224200 status=200 resp_size=5637
2026-01-12 21:23:21.882 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224201&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 21:23:26.970 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163138199?api_key=51job&timestamp=1768224206 status=200 resp_size=5790
2026-01-12 21:23:27.159 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224206&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 21:23:37.730 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167326605?api_key=51job&timestamp=1768224216 status=200 resp_size=5874
2026-01-12 21:23:37.954 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224217&companyId=8826736&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2889
2026-01-12 21:23:48.828 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164902924?api_key=51job&timestamp=1768224227 status=200 resp_size=5585
2026-01-12 21:23:49.108 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224228&companyId=9685568&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3240
2026-01-12 21:23:58.695 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164763117?api_key=51job&timestamp=1768224237 status=200 resp_size=6975
2026-01-12 21:23:58.999 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224238&companyId=9501936&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7850
2026-01-12 21:24:06.037 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/136921478?api_key=51job&timestamp=1768224244 status=200 resp_size=3473
2026-01-12 21:24:06.396 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224246&companyId=6851156&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2184
2026-01-12 21:24:08.708 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169972059?api_key=51job&timestamp=1768224248 status=200 resp_size=6005
2026-01-12 21:24:08.938 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224248&companyId=4499506&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4889
2026-01-12 21:24:08.938 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 3 页数据，包含详细信息的数据条数: 20
2026-01-12 21:24:08.977 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 21:24:08.977 | INFO     | __main__:crawl_multiple_pages:1031 - 第 3 页获取到 20 个职位 | 累计: 60 个
2026-01-12 21:24:15.831 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 6.85 秒后继续...
2026-01-12 21:24:15.831 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 4/10 页...
2026-01-12 21:24:15.831 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:24:15.863 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=4, 页大小=20, 地区=230300, 工作类型=3825
2026-01-12 21:24:17.055 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:24:18.321 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:24:20.616 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:24:20.621 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:24:21.348 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768224255 status=200 resp_size=121825
2026-01-12 21:24:21.351 | INFO     | __main__:get_recommend_jobs:747 - 第 4 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 184 (原始值: 184) | 地区: 大连(230300) | 职能: 挡车工(3825)
2026-01-12 21:24:21.687 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163228668?api_key=51job&timestamp=1768224261 status=200 resp_size=7209
2026-01-12 21:24:21.998 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224261&companyId=9501936&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7850
2026-01-12 21:24:24.210 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170190047?api_key=51job&timestamp=1768224263 status=200 resp_size=4374
2026-01-12 21:24:24.524 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224264&companyId=10145619&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2816
2026-01-12 21:24:28.535 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160552029?api_key=51job&timestamp=1768224268 status=200 resp_size=7209
2026-01-12 21:24:28.820 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224268&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-12 21:24:35.767 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169314323?api_key=51job&timestamp=1768224274 status=200 resp_size=7405
2026-01-12 21:24:36.013 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224275&companyId=7798467&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6611
2026-01-12 21:24:42.434 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/145686870?api_key=51job&timestamp=1768224281 status=200 resp_size=7329
2026-01-12 21:24:42.702 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224282&companyId=309838&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12739
2026-01-12 21:24:46.576 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167692343?api_key=51job&timestamp=1768224286 status=200 resp_size=4975
2026-01-12 21:24:46.801 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224286&companyId=2674810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5239
2026-01-12 21:24:54.965 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166616534?api_key=51job&timestamp=1768224294 status=200 resp_size=5877
2026-01-12 21:24:55.172 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224294&companyId=9827030&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2579
2026-01-12 21:24:57.120 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168414575?api_key=51job&timestamp=1768224296 status=200 resp_size=6850
2026-01-12 21:24:57.308 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224297&companyId=143102&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7176
2026-01-12 21:25:21.762 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168649917?api_key=51job&timestamp=1768224307 status=200 resp_size=5254
2026-01-12 21:25:24.065 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224321&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
2026-01-12 21:25:30.832 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166606993?api_key=51job&timestamp=1768224328 status=200 resp_size=5440
2026-01-12 21:25:32.110 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224330&companyId=8054908&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3024
2026-01-12 21:25:42.089 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170009624?api_key=51job&timestamp=1768224341 status=200 resp_size=4774
2026-01-12 21:25:42.310 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224342&companyId=10087570&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3328
2026-01-12 21:25:45.872 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170208618?api_key=51job&timestamp=1768224345 status=200 resp_size=4737
2026-01-12 21:25:46.091 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224345&companyId=10088749&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3418
2026-01-12 21:25:51.280 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168566307?api_key=51job&timestamp=1768224351 status=200 resp_size=5424
2026-01-12 21:25:51.480 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224351&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
2026-01-12 21:26:01.194 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168912761?api_key=51job&timestamp=1768224359 status=200 resp_size=6122
2026-01-12 21:26:01.470 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224361&companyId=9882618&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3684
2026-01-12 21:26:03.410 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168352270?api_key=51job&timestamp=1768224363 status=200 resp_size=5896
2026-01-12 21:26:03.722 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224363&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
2026-01-12 21:26:07.196 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169766665?api_key=51job&timestamp=1768224366 status=200 resp_size=4911
2026-01-12 21:26:07.458 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224367&companyId=10089231&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3418
2026-01-12 21:26:11.504 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165492185?api_key=51job&timestamp=1768224371 status=200 resp_size=6813
2026-01-12 21:26:13.016 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224371&companyId=9732609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2706
2026-01-12 21:26:14.706 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169286538?api_key=51job&timestamp=1768224374 status=200 resp_size=7511
2026-01-12 21:26:15.061 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224374&companyId=8199797&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9586
2026-01-12 21:26:24.031 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168329370?api_key=51job&timestamp=1768224381 status=200 resp_size=4918
2026-01-12 21:26:25.478 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224384&companyId=9945478&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3473
2026-01-12 21:26:29.826 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165492160?api_key=51job&timestamp=1768224388 status=200 resp_size=6641
2026-01-12 21:26:30.346 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224389&companyId=9732609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2706
2026-01-12 21:26:30.346 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 4 页数据，包含详细信息的数据条数: 20
2026-01-12 21:26:30.402 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 21:26:30.402 | INFO     | __main__:crawl_multiple_pages:1031 - 第 4 页获取到 20 个职位 | 累计: 80 个
2026-01-12 21:26:33.399 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 2.99 秒后继续...
2026-01-12 21:26:33.399 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 5/10 页...
2026-01-12 21:26:33.399 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:26:33.431 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=5, 页大小=20, 地区=230300, 工作类型=3825
2026-01-12 21:26:35.140 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:26:36.397 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:26:38.759 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:26:38.759 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:26:39.611 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768224393 status=200 resp_size=127256
2026-01-12 21:26:39.611 | INFO     | __main__:get_recommend_jobs:747 - 第 5 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 184 (原始值: 184) | 地区: 大连(230300) | 职能: 挡车工(3825)
2026-01-12 21:26:39.968 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166838152?api_key=51job&timestamp=1768224399 status=200 resp_size=5079
2026-01-12 21:26:40.477 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224399&companyId=8054908&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3024
2026-01-12 21:26:42.035 | INFO     | __main__:crawl_recommend_jobs_main:1223 - 用户中断推荐职位爬取
2026-01-12 21:26:42.036 | INFO     | __main__:close:1137 - httpx客户端已关闭
2026-01-12 21:27:02.560 | INFO     | __main__:crawl_recommend_jobs_main:1170 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:27:02.598 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:27:02.625 | INFO     | __main__:crawl_recommend_jobs_main:1198 - 随机选择城市: 淮北 (151700)
2026-01-12 21:27:02.626 | INFO     | __main__:crawl_recommend_jobs_main:1202 - 随机选择工作类型: 成本管理员 (0409)
2026-01-12 21:27:02.626 | INFO     | __main__:crawl_recommend_jobs_main:1204 - 开始爬取推荐职位，最多 50 页
2026-01-12 21:27:02.626 | INFO     | __main__:crawl_multiple_pages:1000 - ================================================================================
2026-01-12 21:27:02.626 | INFO     | __main__:crawl_multiple_pages:1001 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 淮北(151700) | 职能: 成本管理员(0409)
2026-01-12 21:27:02.626 | INFO     | __main__:crawl_multiple_pages:1002 - ================================================================================
2026-01-12 21:27:02.627 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 1/50 页...
2026-01-12 21:27:02.627 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:27:02.641 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=1, 页大小=20, 地区=151700, 工作类型=0409
2026-01-12 21:27:04.216 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:27:05.460 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:27:07.710 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:27:07.710 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:27:08.091 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768224422 status=200 resp_size=48609
2026-01-12 21:27:08.092 | INFO     | __main__:get_recommend_jobs:747 - 第 1 页成功获取 9 个职位（去重后: 9） | API返回totalCount: 9 (原始值: 9) | 地区: 淮北(151700) | 职能: 成本管理员(0409)
2026-01-12 21:27:08.414 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164269226?api_key=51job&timestamp=1768224428 status=200 resp_size=6959
2026-01-12 21:27:08.671 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224428&companyId=7640642&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3797
2026-01-12 21:27:14.885 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169745397?api_key=51job&timestamp=1768224433 status=200 resp_size=7168
2026-01-12 21:27:16.206 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224434&companyId=10016288&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5913
2026-01-12 21:27:27.648 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159348196?api_key=51job&timestamp=1768224445 status=200 resp_size=5342
2026-01-12 21:27:27.872 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224447&companyId=9157456&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2678
2026-01-12 21:27:30.541 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166519483?api_key=51job&timestamp=1768224448 status=200 resp_size=5515
2026-01-12 21:27:30.753 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224450&companyId=9816763&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-12 21:27:41.237 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169802799?api_key=51job&timestamp=1768224460 status=200 resp_size=4716
2026-01-12 21:27:41.514 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224461&companyId=10107860&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2894
2026-01-12 21:27:50.775 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169575655?api_key=51job&timestamp=1768224469 status=200 resp_size=5553
2026-01-12 21:27:51.038 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224470&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
2026-01-12 21:28:00.715 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168377007?api_key=51job&timestamp=1768224479 status=200 resp_size=7231
2026-01-12 21:28:00.968 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224480&companyId=6966653&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3852
2026-01-12 21:28:04.899 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166835861?api_key=51job&timestamp=1768224484 status=200 resp_size=5789
2026-01-12 21:28:05.191 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224484&companyId=8965902&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7240
2026-01-12 21:28:15.442 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169563422?api_key=51job&timestamp=1768224494 status=200 resp_size=6177
2026-01-12 21:28:16.798 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224495&companyId=10086029&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2755
2026-01-12 21:28:16.798 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 1 页数据，包含详细信息的数据条数: 9
2026-01-12 21:28:16.815 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 9, 响应大小: 112 字节
2026-01-12 21:28:16.815 | INFO     | __main__:crawl_multiple_pages:1027 - 检测到API返回totalCount: 9 | 计算需要爬取: 1 页 (每页 20 条) | 预计最大数据: 20 条
2026-01-12 21:28:16.815 | INFO     | __main__:crawl_multiple_pages:1031 - 第 1 页获取到 9 个职位 | 累计: 9 个
2026-01-12 21:28:16.815 | INFO     | __main__:crawl_multiple_pages:1039 - 已获取所有数据 (9/9)，提前结束爬取
2026-01-12 21:28:16.815 | INFO     | __main__:crawl_multiple_pages:1056 - 
================================================================================
2026-01-12 21:28:16.815 | INFO     | __main__:crawl_multiple_pages:1057 - 爬取统计信息:
2026-01-12 21:28:16.815 | INFO     | __main__:crawl_multiple_pages:1058 -   总抓取数量: 9 条
2026-01-12 21:28:16.817 | INFO     | __main__:crawl_multiple_pages:1059 -   去重后数量: 9 条
2026-01-12 21:28:16.817 | INFO     | __main__:crawl_multiple_pages:1060 -   重复数量: 0 条
2026-01-12 21:28:16.817 | INFO     | __main__:crawl_multiple_pages:1061 -   API返回totalCount: 9 条
2026-01-12 21:28:16.817 | INFO     | __main__:crawl_multiple_pages:1062 -   实际爬取页数: 1 页
2026-01-12 21:28:16.817 | INFO     | __main__:crawl_multiple_pages:1063 -   地区: 淮北(151700)
2026-01-12 21:28:16.817 | INFO     | __main__:crawl_multiple_pages:1064 -   职能: 成本管理员(0409)
2026-01-12 21:28:16.817 | INFO     | __main__:crawl_multiple_pages:1067 -   覆盖率: 100.00% (9/9)
2026-01-12 21:28:16.817 | INFO     | __main__:crawl_multiple_pages:1072 - ================================================================================

2026-01-12 21:28:16.817 | INFO     | __main__:save_crawl_stats:131 - 统计信息已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_stats.log
2026-01-12 21:28:16.817 | INFO     | __main__:crawl_multiple_pages:1086 - 职位记录已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_jobs_records.log (共 9 条记录)
2026-01-12 21:28:16.817 | INFO     | __main__:crawl_recommend_jobs_main:1216 - 推荐职位爬取完成！共找到 9 个职位
2026-01-12 21:28:16.817 | INFO     | __main__:close:1137 - httpx客户端已关闭
2026-01-12 21:28:21.585 | INFO     | __main__:crawl_recommend_jobs_main:1170 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:28:21.615 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:28:21.686 | INFO     | __main__:crawl_recommend_jobs_main:1198 - 随机选择城市: 兰州 (270200)
2026-01-12 21:28:21.686 | INFO     | __main__:crawl_recommend_jobs_main:1202 - 随机选择工作类型: 岩土工程 (2119)
2026-01-12 21:28:21.686 | INFO     | __main__:crawl_recommend_jobs_main:1204 - 开始爬取推荐职位，最多 50 页
2026-01-12 21:28:21.687 | INFO     | __main__:crawl_multiple_pages:1000 - ================================================================================
2026-01-12 21:28:21.687 | INFO     | __main__:crawl_multiple_pages:1001 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 兰州(270200) | 职能: 岩土工程(2119)
2026-01-12 21:28:21.687 | INFO     | __main__:crawl_multiple_pages:1002 - ================================================================================
2026-01-12 21:28:21.687 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 1/50 页...
2026-01-12 21:28:21.687 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:28:21.704 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=1, 页大小=20, 地区=270200, 工作类型=2119
2026-01-12 21:28:24.322 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:28:25.709 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:28:28.069 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:28:28.070 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:28:28.809 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768224501 status=200 resp_size=115793
2026-01-12 21:28:28.810 | INFO     | __main__:get_recommend_jobs:747 - 第 1 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 102 (原始值: 102) | 地区: 兰州(270200) | 职能: 岩土工程(2119)
2026-01-12 21:28:30.169 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161468043?api_key=51job&timestamp=1768224508 status=200 resp_size=5948
2026-01-12 21:28:30.669 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224510&companyId=1989258&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10558
2026-01-12 21:28:41.497 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163678320?api_key=51job&timestamp=1768224520 status=200 resp_size=5537
2026-01-12 21:28:41.735 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224521&companyId=8362922&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4417
2026-01-12 21:28:49.128 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164269484?api_key=51job&timestamp=1768224528 status=200 resp_size=6981
2026-01-12 21:28:49.328 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224529&companyId=7640642&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3797
2026-01-12 21:28:57.205 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164804615?api_key=51job&timestamp=1768224536 status=200 resp_size=5439
2026-01-12 21:28:57.466 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224537&companyId=9678090&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7307
2026-01-12 21:29:01.484 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163473297?api_key=51job&timestamp=1768224541 status=200 resp_size=5593
2026-01-12 21:29:01.784 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224541&companyId=2660857&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7869
2026-01-12 21:29:06.410 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163859819?api_key=51job&timestamp=1768224546 status=200 resp_size=6117
2026-01-12 21:29:06.681 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224546&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 21:29:11.429 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165893370?api_key=51job&timestamp=1768224550 status=200 resp_size=5156
2026-01-12 21:29:11.662 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224551&companyId=9771350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6796
2026-01-12 21:29:14.192 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164170726?api_key=51job&timestamp=1768224553 status=200 resp_size=6078
2026-01-12 21:29:14.427 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224554&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-12 21:29:19.610 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170068777?api_key=51job&timestamp=1768224559 status=200 resp_size=5943
2026-01-12 21:29:20.353 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224559&companyId=3981027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6956
2026-01-12 21:29:31.578 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165854340?api_key=51job&timestamp=1768224570 status=200 resp_size=5486
2026-01-12 21:29:31.885 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224571&companyId=9761172&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2550
2026-01-12 21:29:40.268 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166128304?api_key=51job&timestamp=1768224579 status=200 resp_size=5247
2026-01-12 21:29:40.510 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224580&companyId=9790233&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2836
2026-01-12 21:29:48.700 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163321960?api_key=51job&timestamp=1768224586 status=200 resp_size=6114
2026-01-12 21:29:48.977 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224588&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-12 21:29:59.075 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161468452?api_key=51job&timestamp=1768224598 status=200 resp_size=6673
2026-01-12 21:29:59.318 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224599&companyId=1989258&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10558
2026-01-12 21:30:10.072 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160078587?api_key=51job&timestamp=1768224608 status=200 resp_size=5607
2026-01-12 21:30:10.444 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224610&companyId=9199595&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3460
2026-01-12 21:30:16.220 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166454496?api_key=51job&timestamp=1768224614 status=200 resp_size=5768
2026-01-12 21:30:16.478 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224616&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-12 21:30:26.137 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041175?api_key=51job&timestamp=1768224625 status=200 resp_size=6161
2026-01-12 21:30:26.329 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224626&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 21:30:43.534 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163840656?api_key=51job&timestamp=1768224633 status=200 resp_size=5404
2026-01-12 21:30:44.845 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224643&companyId=7108962&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3047
2026-01-12 21:30:56.105 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163193188?api_key=51job&timestamp=1768224654 status=200 resp_size=6294
2026-01-12 21:30:56.397 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224656&companyId=9490549&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2655
2026-01-12 21:31:04.243 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157485396?api_key=51job&timestamp=1768224663 status=200 resp_size=5712
2026-01-12 21:31:04.457 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224664&companyId=8975951&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2671
2026-01-12 21:31:07.950 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158370431?api_key=51job&timestamp=1768224667 status=200 resp_size=5738
2026-01-12 21:31:08.160 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224667&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-12 21:31:08.161 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 1 页数据，包含详细信息的数据条数: 20
2026-01-12 21:31:08.220 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 21:31:08.220 | INFO     | __main__:crawl_multiple_pages:1027 - 检测到API返回totalCount: 102 | 计算需要爬取: 6 页 (每页 20 条) | 预计最大数据: 120 条
2026-01-12 21:31:08.220 | INFO     | __main__:crawl_multiple_pages:1031 - 第 1 页获取到 20 个职位 | 累计: 20 个
2026-01-12 21:31:12.089 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 3.87 秒后继续...
2026-01-12 21:31:12.089 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 2/6 页...
2026-01-12 21:31:12.089 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:31:12.111 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=2, 页大小=20, 地区=270200, 工作类型=2119
2026-01-12 21:31:13.105 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:31:14.358 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:31:16.554 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:31:16.554 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:31:17.089 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768224672 status=200 resp_size=113476
2026-01-12 21:31:17.089 | INFO     | __main__:get_recommend_jobs:747 - 第 2 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 102 (原始值: 102) | 地区: 兰州(270200) | 职能: 岩土工程(2119)
2026-01-12 21:31:17.324 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169560234?api_key=51job&timestamp=1768224677 status=200 resp_size=6595
2026-01-12 21:31:17.556 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224677&companyId=9200002&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4227
2026-01-12 21:31:26.169 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164840669?api_key=51job&timestamp=1768224684 status=200 resp_size=6300
2026-01-12 21:31:26.424 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224686&companyId=9680875&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4102
2026-01-12 21:31:35.904 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162586922?api_key=51job&timestamp=1768224694 status=200 resp_size=4448
2026-01-12 21:31:36.115 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224695&companyId=9383822&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2691
2026-01-12 21:31:37.750 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162205542?api_key=51job&timestamp=1768224697 status=200 resp_size=5069
2026-01-12 21:31:37.933 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224697&companyId=9386397&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2646
2026-01-12 21:31:44.895 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169600143?api_key=51job&timestamp=1768224703 status=200 resp_size=5611
2026-01-12 21:31:45.144 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224704&companyId=2660857&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7869
2026-01-12 21:31:47.474 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041219?api_key=51job&timestamp=1768224707 status=200 resp_size=5799
2026-01-12 21:31:47.779 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224707&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 21:31:51.233 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165192500?api_key=51job&timestamp=1768224710 status=200 resp_size=6323
2026-01-12 21:31:51.492 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224711&companyId=9680875&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4102
2026-01-12 21:31:58.421 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169854625?api_key=51job&timestamp=1768224717 status=200 resp_size=4476
2026-01-12 21:31:58.674 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224718&companyId=10094094&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3446
2026-01-12 21:32:06.302 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/151355039?api_key=51job&timestamp=1768224725 status=200 resp_size=6456
2026-01-12 21:32:06.552 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224726&companyId=143102&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7176
2026-01-12 21:32:15.858 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166894636?api_key=51job&timestamp=1768224734 status=200 resp_size=6410
2026-01-12 21:32:16.461 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224735&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8122
2026-01-12 21:32:24.276 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165537713?api_key=51job&timestamp=1768224743 status=200 resp_size=5257
2026-01-12 21:32:24.463 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224744&companyId=8635625&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2799
2026-01-12 21:32:32.151 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164635815?api_key=51job&timestamp=1768224751 status=200 resp_size=6209
2026-01-12 21:32:32.344 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224752&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4814
2026-01-12 21:32:43.250 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170179144?api_key=51job&timestamp=1768224762 status=200 resp_size=5827
2026-01-12 21:32:43.931 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224763&companyId=10142414&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2923
2026-01-12 21:32:52.345 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162129888?api_key=51job&timestamp=1768224771 status=200 resp_size=4693
2026-01-12 21:32:52.607 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224772&companyId=9310148&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2769
2026-01-12 21:33:02.055 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166626040?api_key=51job&timestamp=1768224780 status=200 resp_size=5731
2026-01-12 21:33:02.656 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224782&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 21:33:11.527 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/150574823?api_key=51job&timestamp=1768224790 status=200 resp_size=6863
2026-01-12 21:33:11.705 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224791&companyId=143102&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7176
2026-01-12 21:33:19.899 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/151060076?api_key=51job&timestamp=1768224798 status=200 resp_size=5835
2026-01-12 21:33:20.468 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224799&companyId=5416321&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5565
2026-01-12 21:33:22.744 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165106577?api_key=51job&timestamp=1768224802 status=200 resp_size=6016
2026-01-12 21:33:23.006 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224802&companyId=9678090&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7307
2026-01-12 21:33:29.756 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/134297663?api_key=51job&timestamp=1768224808 status=200 resp_size=5455
2026-01-12 21:33:29.977 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224809&companyId=3916562&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4108
2026-01-12 21:33:36.646 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170155222?api_key=51job&timestamp=1768224815 status=200 resp_size=6794
2026-01-12 21:33:36.995 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224816&companyId=10011319&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6666
2026-01-12 21:33:36.995 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 2 页数据，包含详细信息的数据条数: 20
2026-01-12 21:33:37.039 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 21:33:37.039 | INFO     | __main__:crawl_multiple_pages:1031 - 第 2 页获取到 20 个职位 | 累计: 40 个
2026-01-12 21:33:43.517 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 6.48 秒后继续...
2026-01-12 21:33:43.517 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 3/6 页...
2026-01-12 21:33:43.517 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:33:43.530 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=3, 页大小=20, 地区=270200, 工作类型=2119
2026-01-12 21:33:44.424 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:33:45.633 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:33:47.846 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:33:47.847 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:33:48.534 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768224823 status=200 resp_size=124877
2026-01-12 21:33:48.535 | INFO     | __main__:get_recommend_jobs:747 - 第 3 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 102 (原始值: 102) | 地区: 兰州(270200) | 职能: 岩土工程(2119)
2026-01-12 21:33:48.807 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170192420?api_key=51job&timestamp=1768224828 status=200 resp_size=5000
2026-01-12 21:33:49.062 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224828&companyId=5556717&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12435
2026-01-12 21:33:51.978 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167400733?api_key=51job&timestamp=1768224831 status=200 resp_size=5730
2026-01-12 21:33:52.234 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224831&companyId=9678090&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7307
2026-01-12 21:33:53.692 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166167328?api_key=51job&timestamp=1768224833 status=200 resp_size=5850
2026-01-12 21:33:53.950 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224833&companyId=2779923&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5250
2026-01-12 21:33:56.055 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167459547?api_key=51job&timestamp=1768224835 status=200 resp_size=5611
2026-01-12 21:33:56.684 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224836&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 21:33:59.488 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167301548?api_key=51job&timestamp=1768224839 status=200 resp_size=6723
2026-01-12 21:33:59.761 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224839&companyId=8965902&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7240
2026-01-12 21:34:01.944 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165122479?api_key=51job&timestamp=1768224841 status=200 resp_size=5998
2026-01-12 21:34:02.272 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224841&companyId=9678090&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7307
2026-01-12 21:34:11.460 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169052458?api_key=51job&timestamp=1768224850 status=200 resp_size=6395
2026-01-12 21:34:11.676 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224851&companyId=2779923&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5250
2026-01-12 21:34:13.745 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166772390?api_key=51job&timestamp=1768224853 status=200 resp_size=5895
2026-01-12 21:34:13.928 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224853&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 21:34:17.610 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169105610?api_key=51job&timestamp=1768224857 status=200 resp_size=5593
2026-01-12 21:34:17.791 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224857&companyId=10035656&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2776
2026-01-12 21:34:23.813 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170229573?api_key=51job&timestamp=1768224862 status=200 resp_size=5438
2026-01-12 21:34:24.063 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224863&companyId=8933985&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4000
2026-01-12 21:34:31.352 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170184212?api_key=51job&timestamp=1768224870 status=200 resp_size=4129
2026-01-12 21:34:31.551 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224871&companyId=10145218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2834
2026-01-12 21:34:38.915 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166396550?api_key=51job&timestamp=1768224878 status=200 resp_size=5887
2026-01-12 21:34:39.105 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224878&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 21:34:49.181 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165801635?api_key=51job&timestamp=1768224887 status=200 resp_size=5562
2026-01-12 21:34:49.457 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224889&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 21:34:56.100 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162279496?api_key=51job&timestamp=1768224895 status=200 resp_size=6619
2026-01-12 21:34:56.289 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224896&companyId=7627786&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5445
2026-01-12 21:35:01.198 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167367600?api_key=51job&timestamp=1768224900 status=200 resp_size=6808
2026-01-12 21:35:01.784 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224901&companyId=9551553&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6108
2026-01-12 21:35:10.978 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167851472?api_key=51job&timestamp=1768224910 status=200 resp_size=5924
2026-01-12 21:35:11.171 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224910&companyId=9827590&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3015
2026-01-12 21:35:16.205 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168426939?api_key=51job&timestamp=1768224915 status=200 resp_size=7231
2026-01-12 21:35:16.397 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224916&companyId=6966653&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3852
2026-01-12 21:35:25.855 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170002251?api_key=51job&timestamp=1768224923 status=200 resp_size=6466
2026-01-12 21:35:26.135 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224925&companyId=9912798&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8440
2026-01-12 21:35:33.370 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170081869?api_key=51job&timestamp=1768224932 status=200 resp_size=6339
2026-01-12 21:35:33.612 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224933&companyId=10134359&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2933
2026-01-12 21:35:38.366 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169800843?api_key=51job&timestamp=1768224938 status=200 resp_size=5571
2026-01-12 21:35:38.599 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224938&companyId=9987348&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3329
2026-01-12 21:35:38.599 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 3 页数据，包含详细信息的数据条数: 20
2026-01-12 21:35:46.770 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 21:35:46.770 | INFO     | __main__:crawl_multiple_pages:1031 - 第 3 页获取到 20 个职位 | 累计: 60 个
2026-01-12 21:35:56.569 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 9.80 秒后继续...
2026-01-12 21:35:56.569 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 4/6 页...
2026-01-12 21:35:56.570 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:35:56.597 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=4, 页大小=20, 地区=270200, 工作类型=2119
2026-01-12 21:35:57.390 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:35:58.577 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:36:00.748 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:36:00.748 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:36:01.177 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768224956 status=200 resp_size=120149
2026-01-12 21:36:01.178 | INFO     | __main__:get_recommend_jobs:747 - 第 4 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 102 (原始值: 102) | 地区: 兰州(270200) | 职能: 岩土工程(2119)
2026-01-12 21:36:01.381 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169962902?api_key=51job&timestamp=1768224961 status=200 resp_size=5889
2026-01-12 21:36:01.592 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224961&companyId=9896020&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7398
2026-01-12 21:36:05.189 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169256476?api_key=51job&timestamp=1768224964 status=200 resp_size=6321
2026-01-12 21:36:05.383 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224965&companyId=10028121&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2934
2026-01-12 21:36:15.280 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169576210?api_key=51job&timestamp=1768224973 status=200 resp_size=5581
2026-01-12 21:36:16.645 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224975&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
2026-01-12 21:36:18.419 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086375?api_key=51job&timestamp=1768224978 status=200 resp_size=5237
2026-01-12 21:36:18.715 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224978&companyId=10090180&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2848
2026-01-12 21:36:22.189 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167048652?api_key=51job&timestamp=1768224981 status=200 resp_size=6607
2026-01-12 21:36:22.649 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224982&companyId=9783603&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3141
2026-01-12 21:36:25.938 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170189067?api_key=51job&timestamp=1768224984 status=200 resp_size=5464
2026-01-12 21:36:26.257 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224985&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
2026-01-12 21:36:34.260 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169963008?api_key=51job&timestamp=1768224993 status=200 resp_size=6012
2026-01-12 21:36:34.520 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768224994&companyId=9896052&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7783
2026-01-12 21:36:46.765 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168446553?api_key=51job&timestamp=1768225000 status=200 resp_size=6339
2026-01-12 21:36:47.014 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225006&companyId=9673973&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4319
2026-01-12 21:36:53.154 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169962771?api_key=51job&timestamp=1768225012 status=200 resp_size=5874
2026-01-12 21:36:53.393 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225013&companyId=9896020&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7398
2026-01-12 21:37:04.842 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170071365?api_key=51job&timestamp=1768225023 status=200 resp_size=6503
2026-01-12 21:37:05.230 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225024&companyId=9953821&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2612
2026-01-12 21:37:12.776 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169962991?api_key=51job&timestamp=1768225032 status=200 resp_size=6063
2026-01-12 21:37:12.977 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225032&companyId=9896052&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7783
2026-01-12 21:37:16.830 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167301470?api_key=51job&timestamp=1768225036 status=200 resp_size=6243
2026-01-12 21:37:17.008 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225036&companyId=9673973&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4319
2026-01-12 21:37:28.032 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169340566?api_key=51job&timestamp=1768225044 status=200 resp_size=5558
2026-01-12 21:37:28.271 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225048&companyId=10054286&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2900
2026-01-12 21:37:35.729 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169023029?api_key=51job&timestamp=1768225054 status=200 resp_size=6205
2026-01-12 21:37:36.144 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225055&companyId=10028121&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2934
2026-01-12 21:37:43.339 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169381242?api_key=51job&timestamp=1768225062 status=200 resp_size=5783
2026-01-12 21:37:43.524 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225063&companyId=9987348&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3329
2026-01-12 21:37:51.870 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170027787?api_key=51job&timestamp=1768225070 status=200 resp_size=7013
2026-01-12 21:37:52.137 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225071&companyId=9896052&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7783
2026-01-12 21:38:01.661 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170184669?api_key=51job&timestamp=1768225080 status=200 resp_size=5554
2026-01-12 21:38:01.867 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225081&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
2026-01-12 21:38:06.701 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169345561?api_key=51job&timestamp=1768225086 status=200 resp_size=7249
2026-01-12 21:38:06.921 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225086&companyId=7537623&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9097
2026-01-12 21:38:16.510 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169259038?api_key=51job&timestamp=1768225095 status=200 resp_size=5678
2026-01-12 21:38:17.906 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225096&companyId=9898773&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2705
2026-01-12 21:38:19.562 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166229241?api_key=51job&timestamp=1768225099 status=200 resp_size=7488
2026-01-12 21:38:19.867 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225099&companyId=2380332&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6017
2026-01-12 21:38:19.867 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 4 页数据，包含详细信息的数据条数: 20
2026-01-12 21:38:19.899 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 21:38:19.899 | INFO     | __main__:crawl_multiple_pages:1031 - 第 4 页获取到 20 个职位 | 累计: 80 个
2026-01-12 21:38:28.394 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 8.49 秒后继续...
2026-01-12 21:38:28.394 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 5/6 页...
2026-01-12 21:38:28.394 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:38:28.409 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=5, 页大小=20, 地区=270200, 工作类型=2119
2026-01-12 21:38:29.363 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:38:30.772 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:38:33.119 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:38:33.119 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:38:33.678 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768225108 status=200 resp_size=126778
2026-01-12 21:38:33.678 | INFO     | __main__:get_recommend_jobs:747 - 第 5 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 102 (原始值: 102) | 地区: 兰州(270200) | 职能: 岩土工程(2119)
2026-01-12 21:38:34.350 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168787979?api_key=51job&timestamp=1768225113 status=200 resp_size=5664
2026-01-12 21:38:34.770 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225114&companyId=9898773&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2705
2026-01-12 21:38:36.740 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161446376?api_key=51job&timestamp=1768225116 status=200 resp_size=5504
2026-01-12 21:38:36.980 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225116&companyId=3916562&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4108
2026-01-12 21:38:39.896 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166470176?api_key=51job&timestamp=1768225119 status=200 resp_size=7708
2026-01-12 21:38:40.475 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225119&companyId=9016711&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8114
2026-01-12 21:38:47.862 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168413793?api_key=51job&timestamp=1768225126 status=200 resp_size=6200
2026-01-12 21:38:48.126 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225127&companyId=9790398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
2026-01-12 21:38:49.755 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163032742?api_key=51job&timestamp=1768225129 status=200 resp_size=6191
2026-01-12 21:38:50.005 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225129&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 21:38:57.867 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167299530?api_key=51job&timestamp=1768225136 status=200 resp_size=5071
2026-01-12 21:38:58.389 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225137&companyId=2248750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12778
2026-01-12 21:39:05.548 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169127131?api_key=51job&timestamp=1768225144 status=200 resp_size=5931
2026-01-12 21:39:05.981 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225145&companyId=9237592&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3625
2026-01-12 21:39:13.961 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164795933?api_key=51job&timestamp=1768225152 status=200 resp_size=5743
2026-01-12 21:39:14.221 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225153&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 21:39:23.951 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169434756?api_key=51job&timestamp=1768225161 status=200 resp_size=5578
2026-01-12 21:39:24.328 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225163&companyId=5176547&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=18708
2026-01-12 21:39:34.944 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169492333?api_key=51job&timestamp=1768225172 status=200 resp_size=5940
2026-01-12 21:39:35.260 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225174&companyId=9404026&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3016
2026-01-12 21:39:40.022 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168983572?api_key=51job&timestamp=1768225179 status=200 resp_size=5532
2026-01-12 21:39:40.307 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225180&companyId=9825106&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5539
2026-01-12 21:39:47.195 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167943013?api_key=51job&timestamp=1768225186 status=200 resp_size=5697
2026-01-12 21:39:47.465 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225187&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 21:39:51.664 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152802087?api_key=51job&timestamp=1768225191 status=200 resp_size=6395
2026-01-12 21:39:51.941 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225191&companyId=2338889&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11565
2026-01-12 21:40:00.740 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165012326?api_key=51job&timestamp=1768225197 status=200 resp_size=5674
2026-01-12 21:40:01.062 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225200&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 21:40:06.250 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170079888?api_key=51job&timestamp=1768225205 status=200 resp_size=5055
2026-01-12 21:40:06.528 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225206&companyId=10135176&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2798
2026-01-12 21:40:17.058 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169986528?api_key=51job&timestamp=1768225215 status=200 resp_size=4877
2026-01-12 21:40:17.327 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225217&companyId=10126017&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2858
2026-01-12 21:40:19.732 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167267764?api_key=51job&timestamp=1768225219 status=200 resp_size=5636
2026-01-12 21:40:20.436 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225219&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 21:40:28.846 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170088660?api_key=51job&timestamp=1768225227 status=200 resp_size=4283
2026-01-12 21:40:29.069 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225228&companyId=10136600&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2746
2026-01-12 21:40:39.020 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170051234?api_key=51job&timestamp=1768225235 status=200 resp_size=4843
2026-01-12 21:40:39.335 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225239&companyId=10132312&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2900
2026-01-12 21:40:41.800 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169894319?api_key=51job&timestamp=1768225241 status=200 resp_size=4883
2026-01-12 21:40:42.084 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225241&companyId=10116649&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2780
2026-01-12 21:40:42.084 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 5 页数据，包含详细信息的数据条数: 20
2026-01-12 21:40:58.384 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 21:40:58.385 | INFO     | __main__:crawl_multiple_pages:1031 - 第 5 页获取到 20 个职位 | 累计: 100 个
2026-01-12 21:41:06.912 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 8.53 秒后继续...
2026-01-12 21:41:06.912 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 6/6 页...
2026-01-12 21:41:06.913 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:41:06.936 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=6, 页大小=20, 地区=270200, 工作类型=2119
2026-01-12 21:41:08.205 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:41:09.914 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:41:12.244 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:41:12.244 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:41:12.766 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768225266 status=200 resp_size=11246
2026-01-12 21:41:12.766 | INFO     | __main__:get_recommend_jobs:747 - 第 6 页成功获取 2 个职位（去重后: 2） | API返回totalCount: 102 (原始值: 102) | 地区: 兰州(270200) | 职能: 岩土工程(2119)
2026-01-12 21:41:13.230 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164953605?api_key=51job&timestamp=1768225272 status=200 resp_size=4944
2026-01-12 21:41:14.695 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225273&companyId=726892&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6645
2026-01-12 21:41:25.720 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169919310?api_key=51job&timestamp=1768225284 status=200 resp_size=4229
2026-01-12 21:41:26.011 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225285&companyId=10119903&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2762
2026-01-12 21:41:26.011 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 6 页数据，包含详细信息的数据条数: 2
2026-01-12 21:41:42.199 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 2, 响应大小: 112 字节
2026-01-12 21:41:42.199 | INFO     | __main__:crawl_multiple_pages:1031 - 第 6 页获取到 2 个职位 | 累计: 102 个
2026-01-12 21:41:42.200 | INFO     | __main__:crawl_multiple_pages:1039 - 已获取所有数据 (102/102)，提前结束爬取
2026-01-12 21:41:42.200 | INFO     | __main__:crawl_multiple_pages:1056 - 
================================================================================
2026-01-12 21:41:42.200 | INFO     | __main__:crawl_multiple_pages:1057 - 爬取统计信息:
2026-01-12 21:41:42.200 | INFO     | __main__:crawl_multiple_pages:1058 -   总抓取数量: 102 条
2026-01-12 21:41:42.200 | INFO     | __main__:crawl_multiple_pages:1059 -   去重后数量: 102 条
2026-01-12 21:41:42.200 | INFO     | __main__:crawl_multiple_pages:1060 -   重复数量: 0 条
2026-01-12 21:41:42.200 | INFO     | __main__:crawl_multiple_pages:1061 -   API返回totalCount: 102 条
2026-01-12 21:41:42.200 | INFO     | __main__:crawl_multiple_pages:1062 -   实际爬取页数: 6 页
2026-01-12 21:41:42.200 | INFO     | __main__:crawl_multiple_pages:1063 -   地区: 兰州(270200)
2026-01-12 21:41:42.200 | INFO     | __main__:crawl_multiple_pages:1064 -   职能: 岩土工程(2119)
2026-01-12 21:41:42.200 | INFO     | __main__:crawl_multiple_pages:1067 -   覆盖率: 100.00% (102/102)
2026-01-12 21:41:42.200 | INFO     | __main__:crawl_multiple_pages:1072 - ================================================================================

2026-01-12 21:41:42.201 | INFO     | __main__:save_crawl_stats:131 - 统计信息已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_stats.log
2026-01-12 21:41:42.201 | INFO     | __main__:crawl_multiple_pages:1086 - 职位记录已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_jobs_records.log (共 102 条记录)
2026-01-12 21:41:42.201 | INFO     | __main__:crawl_recommend_jobs_main:1216 - 推荐职位爬取完成！共找到 102 个职位
2026-01-12 21:41:42.201 | INFO     | __main__:close:1137 - httpx客户端已关闭
2026-01-12 21:41:43.662 | INFO     | __main__:crawl_recommend_jobs_main:1170 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:41:43.696 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:41:43.750 | INFO     | __main__:crawl_recommend_jobs_main:1198 - 随机选择城市: 温州 (80400)
2026-01-12 21:41:43.751 | INFO     | __main__:crawl_recommend_jobs_main:1202 - 随机选择工作类型: 团购业务员 (3008)
2026-01-12 21:41:43.751 | INFO     | __main__:crawl_recommend_jobs_main:1204 - 开始爬取推荐职位，最多 50 页
2026-01-12 21:41:43.751 | INFO     | __main__:crawl_multiple_pages:1000 - ================================================================================
2026-01-12 21:41:43.751 | INFO     | __main__:crawl_multiple_pages:1001 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 温州(80400) | 职能: 团购业务员(3008)
2026-01-12 21:41:43.751 | INFO     | __main__:crawl_multiple_pages:1002 - ================================================================================
2026-01-12 21:41:43.751 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 1/50 页...
2026-01-12 21:41:43.751 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:41:43.764 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=1, 页大小=20, 地区=80400, 工作类型=3008
2026-01-12 21:41:44.681 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:41:45.898 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:41:48.113 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:41:48.113 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:41:48.806 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768225303 status=200 resp_size=123934
2026-01-12 21:41:48.806 | INFO     | __main__:get_recommend_jobs:747 - 第 1 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 温州(80400) | 职能: 团购业务员(3008)
2026-01-12 21:41:49.100 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167971991?api_key=51job&timestamp=1768225308 status=200 resp_size=5976
2026-01-12 21:41:49.350 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225309&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7854
2026-01-12 21:41:56.813 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160369868?api_key=51job&timestamp=1768225315 status=200 resp_size=5589
2026-01-12 21:41:56.988 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225316&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-12 21:42:06.050 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160371871?api_key=51job&timestamp=1768225325 status=200 resp_size=5194
2026-01-12 21:42:06.305 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225326&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-12 21:42:19.383 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370349?api_key=51job&timestamp=1768225335 status=200 resp_size=5556
2026-01-12 21:42:19.765 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225339&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-12 21:42:25.181 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170204019?api_key=51job&timestamp=1768225343 status=200 resp_size=6337
2026-01-12 21:42:26.542 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225345&companyId=5310383&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10138
2026-01-12 21:42:31.293 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370126?api_key=51job&timestamp=1768225350 status=200 resp_size=5643
2026-01-12 21:42:31.601 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225351&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-12 21:42:39.602 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170180102?api_key=51job&timestamp=1768225358 status=200 resp_size=5175
2026-01-12 21:42:39.790 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225359&companyId=10108008&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3416
2026-01-12 21:42:50.245 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158771407?api_key=51job&timestamp=1768225368 status=200 resp_size=8637
2026-01-12 21:42:50.810 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225370&companyId=2928943&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8069
2026-01-12 21:42:56.094 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170231408?api_key=51job&timestamp=1768225375 status=200 resp_size=6170
2026-01-12 21:42:56.339 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225376&companyId=6883541&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=15527
2026-01-12 21:42:58.930 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169411076?api_key=51job&timestamp=1768225378 status=200 resp_size=6609
2026-01-12 21:42:59.252 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225378&companyId=9786290&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3407
2026-01-12 21:43:10.346 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161323778?api_key=51job&timestamp=1768225386 status=200 resp_size=5893
2026-01-12 21:43:10.615 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225390&companyId=5277541&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5138
2026-01-12 21:43:21.747 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170102899?api_key=51job&timestamp=1768225400 status=200 resp_size=6056
2026-01-12 21:43:22.125 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225401&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-12 21:43:31.018 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804396?api_key=51job&timestamp=1768225409 status=200 resp_size=6417
2026-01-12 21:43:31.295 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225411&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 21:43:40.850 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163138192?api_key=51job&timestamp=1768225419 status=200 resp_size=5813
2026-01-12 21:43:42.396 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225420&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 21:43:49.322 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161941101?api_key=51job&timestamp=1768225427 status=200 resp_size=4918
2026-01-12 21:43:49.699 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225429&companyId=9330961&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3292
2026-01-12 21:43:56.754 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126563?api_key=51job&timestamp=1768225435 status=200 resp_size=6081
2026-01-12 21:43:57.253 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225436&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-12 21:44:09.024 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170076491?api_key=51job&timestamp=1768225446 status=200 resp_size=6980
2026-01-12 21:44:09.279 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225449&companyId=2429099&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6736
2026-01-12 21:44:11.891 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167300668?api_key=51job&timestamp=1768225450 status=200 resp_size=7054
2026-01-12 21:44:12.143 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225451&companyId=8383779&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
2026-01-12 21:44:16.667 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164959350?api_key=51job&timestamp=1768225456 status=200 resp_size=5738
2026-01-12 21:44:46.676 | ERROR    | __main__:_make_request:632 - 请求异常 (尝试 1/3): The read operation timed out
2026-01-12 21:44:48.976 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225456&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 21:44:55.315 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158438599?api_key=51job&timestamp=1768225494 status=200 resp_size=5476
2026-01-12 21:44:55.585 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225495&companyId=8059756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6355
2026-01-12 21:44:55.585 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 1 页数据，包含详细信息的数据条数: 20
2026-01-12 21:44:55.643 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 21:44:55.643 | INFO     | __main__:crawl_multiple_pages:1027 - 检测到API返回totalCount: 501 | 计算需要爬取: 26 页 (每页 20 条) | 预计最大数据: 520 条
2026-01-12 21:44:55.643 | INFO     | __main__:crawl_multiple_pages:1031 - 第 1 页获取到 20 个职位 | 累计: 20 个
2026-01-12 21:44:57.003 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 1.36 秒后继续...
2026-01-12 21:44:57.003 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 2/26 页...
2026-01-12 21:44:57.003 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:44:57.015 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=2, 页大小=20, 地区=80400, 工作类型=3008
2026-01-12 21:44:58.013 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:44:59.214 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:45:01.422 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:45:01.422 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:45:01.915 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768225497 status=200 resp_size=112174
2026-01-12 21:45:01.915 | INFO     | __main__:get_recommend_jobs:747 - 第 2 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 温州(80400) | 职能: 团购业务员(3008)
2026-01-12 21:45:02.214 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050033?api_key=51job&timestamp=1768225501 status=200 resp_size=6033
2026-01-12 21:45:02.458 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225502&companyId=10126395&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2865
2026-01-12 21:45:06.975 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169175063?api_key=51job&timestamp=1768225506 status=200 resp_size=6264
2026-01-12 21:45:07.362 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225506&companyId=10007015&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5841
2026-01-12 21:45:10.791 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167697904?api_key=51job&timestamp=1768225510 status=200 resp_size=5738
2026-01-12 21:45:11.093 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225510&companyId=9502700&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3664
2026-01-12 21:45:13.524 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163080620?api_key=51job&timestamp=1768225513 status=200 resp_size=5638
2026-01-12 21:45:13.776 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225513&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 21:45:16.123 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170208755?api_key=51job&timestamp=1768225515 status=200 resp_size=6386
2026-01-12 21:45:16.641 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225516&companyId=10101579&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3029
2026-01-12 21:45:26.353 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170132288?api_key=51job&timestamp=1768225523 status=200 resp_size=5098
2026-01-12 21:45:26.719 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225526&companyId=10140534&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 21:45:28.579 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165612676?api_key=51job&timestamp=1768225528 status=200 resp_size=6273
2026-01-12 21:45:29.229 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225528&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4814
2026-01-12 21:45:31.160 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160041583?api_key=51job&timestamp=1768225530 status=200 resp_size=5371
2026-01-12 21:45:31.511 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225531&companyId=8395725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3112
2026-01-12 21:45:37.519 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323849?api_key=51job&timestamp=1768225536 status=200 resp_size=7193
2026-01-12 21:45:37.752 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225537&companyId=8899718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8455
2026-01-12 21:45:41.686 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165890498?api_key=51job&timestamp=1768225541 status=200 resp_size=5184
2026-01-12 21:45:41.911 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225541&companyId=9771350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6796
2026-01-12 21:45:46.691 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168858074?api_key=51job&timestamp=1768225546 status=200 resp_size=5022
2026-01-12 21:45:47.138 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225546&companyId=9520344&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2988
2026-01-12 21:45:57.336 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159683606?api_key=51job&timestamp=1768225555 status=200 resp_size=6134
2026-01-12 21:45:57.624 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225557&companyId=8006731&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2565
2026-01-12 21:46:09.263 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170080054?api_key=51job&timestamp=1768225567 status=200 resp_size=6193
2026-01-12 21:46:09.783 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225569&companyId=10121432&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5374
2026-01-12 21:46:18.501 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160078565?api_key=51job&timestamp=1768225577 status=200 resp_size=5612
2026-01-12 21:46:18.683 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225578&companyId=9199595&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3460
2026-01-12 21:46:29.104 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166840546?api_key=51job&timestamp=1768225588 status=200 resp_size=5128
2026-01-12 21:46:29.346 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225589&companyId=9248576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2692
2026-01-12 21:46:34.607 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166855655?api_key=51job&timestamp=1768225594 status=200 resp_size=5975
2026-01-12 21:46:34.831 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225594&companyId=9551781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2660
2026-01-12 21:46:42.647 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170114968?api_key=51job&timestamp=1768225601 status=200 resp_size=6322
2026-01-12 21:46:43.394 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225602&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
2026-01-12 21:46:51.747 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166173609?api_key=51job&timestamp=1768225610 status=200 resp_size=5628
2026-01-12 21:46:52.118 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225611&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-12 21:47:01.566 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041266?api_key=51job&timestamp=1768225620 status=200 resp_size=5839
2026-01-12 21:47:01.794 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225621&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 21:47:04.121 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170093398?api_key=51job&timestamp=1768225623 status=200 resp_size=5407
2026-01-12 21:47:04.363 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225624&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-12 21:47:04.364 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 2 页数据，包含详细信息的数据条数: 20
2026-01-12 21:47:04.388 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 21:47:04.388 | INFO     | __main__:crawl_multiple_pages:1031 - 第 2 页获取到 20 个职位 | 累计: 40 个
2026-01-12 21:47:06.349 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 1.96 秒后继续...
2026-01-12 21:47:06.349 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 3/26 页...
2026-01-12 21:47:06.349 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:47:06.362 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=3, 页大小=20, 地区=80400, 工作类型=3008
2026-01-12 21:47:08.642 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:47:10.558 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:47:13.646 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:47:13.646 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:47:14.868 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768225626 status=200 resp_size=110364
2026-01-12 21:47:14.868 | INFO     | __main__:get_recommend_jobs:747 - 第 3 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 温州(80400) | 职能: 团购业务员(3008)
2026-01-12 21:47:15.945 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169609507?api_key=51job&timestamp=1768225634 status=200 resp_size=5902
2026-01-12 21:47:16.710 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225635&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 21:47:21.155 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168253127?api_key=51job&timestamp=1768225640 status=200 resp_size=5619
2026-01-12 21:47:21.408 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225641&companyId=9848116&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3803
2026-01-12 21:47:25.669 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166113366?api_key=51job&timestamp=1768225645 status=200 resp_size=5709
2026-01-12 21:47:25.944 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225645&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-12 21:47:35.753 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166179432?api_key=51job&timestamp=1768225654 status=200 resp_size=5612
2026-01-12 21:47:36.219 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225655&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-12 21:47:43.616 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169652013?api_key=51job&timestamp=1768225662 status=200 resp_size=6336
2026-01-12 21:47:43.868 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225663&companyId=5882528&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7948
2026-01-12 21:47:53.692 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322119?api_key=51job&timestamp=1768225672 status=200 resp_size=6499
2026-01-12 21:47:53.943 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225673&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-12 21:48:03.690 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166519728?api_key=51job&timestamp=1768225682 status=200 resp_size=5510
2026-01-12 21:48:03.916 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225683&companyId=9816763&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-12 21:48:12.029 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041305?api_key=51job&timestamp=1768225690 status=200 resp_size=5799
2026-01-12 21:48:12.320 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225692&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 21:48:15.566 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169657873?api_key=51job&timestamp=1768225695 status=200 resp_size=6452
2026-01-12 21:48:15.909 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225695&companyId=10094056&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6505
2026-01-12 21:48:20.829 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167246198?api_key=51job&timestamp=1768225700 status=200 resp_size=5684
2026-01-12 21:48:21.150 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225700&companyId=9856387&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3703
2026-01-12 21:48:29.489 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166822227?api_key=51job&timestamp=1768225708 status=200 resp_size=6312
2026-01-12 21:48:29.784 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225709&companyId=9210539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3106
2026-01-12 21:48:31.821 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161788718?api_key=51job&timestamp=1768225711 status=200 resp_size=5148
2026-01-12 21:48:32.146 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225711&companyId=9366134&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3620
2026-01-12 21:48:38.186 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447969?api_key=51job&timestamp=1768225716 status=200 resp_size=5748
2026-01-12 21:48:38.731 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225718&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 21:48:45.610 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041169?api_key=51job&timestamp=1768225724 status=200 resp_size=5967
2026-01-12 21:48:46.915 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225725&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 21:48:52.968 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322023?api_key=51job&timestamp=1768225732 status=200 resp_size=5836
2026-01-12 21:48:53.149 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225732&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-12 21:49:02.930 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163273848?api_key=51job&timestamp=1768225742 status=200 resp_size=5179
2026-01-12 21:49:03.110 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225742&companyId=9043175&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2725
2026-01-12 21:49:10.246 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170200018?api_key=51job&timestamp=1768225748 status=200 resp_size=8501
2026-01-12 21:49:11.257 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225750&companyId=9861992&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4825
2026-01-12 21:49:20.726 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158054032?api_key=51job&timestamp=1768225759 status=200 resp_size=5998
2026-01-12 21:49:20.930 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225760&companyId=9057358&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2681
2026-01-12 21:49:26.881 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857801?api_key=51job&timestamp=1768225766 status=200 resp_size=6055
2026-01-12 21:49:27.072 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225766&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 21:49:35.208 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166174784?api_key=51job&timestamp=1768225774 status=200 resp_size=5351
2026-01-12 21:49:35.395 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225775&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-12 21:49:35.396 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 3 页数据，包含详细信息的数据条数: 20
2026-01-12 21:49:35.434 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 21:49:35.434 | INFO     | __main__:crawl_multiple_pages:1031 - 第 3 页获取到 20 个职位 | 累计: 60 个
2026-01-12 21:49:42.315 | INFO     | __main__:crawl_recommend_jobs_main:1223 - 用户中断推荐职位爬取
2026-01-12 21:49:42.316 | INFO     | __main__:close:1137 - httpx客户端已关闭
2026-01-12 21:49:57.780 | INFO     | __main__:crawl_recommend_jobs_main:1170 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:49:57.828 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:49:57.855 | INFO     | __main__:crawl_recommend_jobs_main:1198 - 随机选择城市: 漳州 (110500)
2026-01-12 21:49:57.855 | INFO     | __main__:crawl_recommend_jobs_main:1202 - 随机选择工作类型: 商务专员 (3111)
2026-01-12 21:49:57.855 | INFO     | __main__:crawl_recommend_jobs_main:1204 - 开始爬取推荐职位，最多 50 页
2026-01-12 21:49:57.855 | INFO     | __main__:crawl_multiple_pages:1000 - ================================================================================
2026-01-12 21:49:57.855 | INFO     | __main__:crawl_multiple_pages:1001 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 漳州(110500) | 职能: 商务专员(3111)
2026-01-12 21:49:57.856 | INFO     | __main__:crawl_multiple_pages:1002 - ================================================================================
2026-01-12 21:49:57.856 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 1/50 页...
2026-01-12 21:49:57.856 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:49:57.868 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=1, 页大小=20, 地区=110500, 工作类型=3111
2026-01-12 21:49:59.517 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:50:00.886 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:50:03.899 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:50:03.899 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:50:04.702 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768225797 status=200 resp_size=122695
2026-01-12 21:50:04.702 | INFO     | __main__:get_recommend_jobs:747 - 第 1 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 70 (原始值: 70) | 地区: 漳州(110500) | 职能: 商务专员(3111)
2026-01-12 21:50:05.206 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170218755?api_key=51job&timestamp=1768225804 status=200 resp_size=6795
2026-01-12 21:50:05.781 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225805&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:50:09.274 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162204846?api_key=51job&timestamp=1768225808 status=200 resp_size=5713
2026-01-12 21:50:09.819 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225809&companyId=9371380&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5199
2026-01-12 21:50:17.009 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164867795?api_key=51job&timestamp=1768225815 status=200 resp_size=5442
2026-01-12 21:50:17.249 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225817&companyId=9496587&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2726
2026-01-12 21:50:18.860 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160028241?api_key=51job&timestamp=1768225818 status=200 resp_size=5705
2026-01-12 21:50:19.115 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225818&companyId=9199595&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3460
2026-01-12 21:50:21.155 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162051274?api_key=51job&timestamp=1768225820 status=200 resp_size=6095
2026-01-12 21:50:21.406 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225821&companyId=8667276&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5578
2026-01-12 21:50:29.056 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163211072?api_key=51job&timestamp=1768225828 status=200 resp_size=5660
2026-01-12 21:50:29.301 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225829&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 21:50:34.364 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169878991?api_key=51job&timestamp=1768225834 status=200 resp_size=5387
2026-01-12 21:50:34.791 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225834&companyId=3322279&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6970
2026-01-12 21:50:44.958 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170179070?api_key=51job&timestamp=1768225841 status=200 resp_size=6269
2026-01-12 21:50:45.254 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225844&companyId=10141224&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2646
2026-01-12 21:50:47.489 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170217950?api_key=51job&timestamp=1768225847 status=200 resp_size=6719
2026-01-12 21:50:47.780 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225847&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:50:56.317 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161865729?api_key=51job&timestamp=1768225855 status=200 resp_size=6511
2026-01-12 21:50:56.508 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225856&companyId=8667276&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5578
2026-01-12 21:51:07.302 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168054176?api_key=51job&timestamp=1768225866 status=200 resp_size=5597
2026-01-12 21:51:07.509 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225867&companyId=9363710&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4357
2026-01-12 21:51:14.897 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170178984?api_key=51job&timestamp=1768225874 status=200 resp_size=6244
2026-01-12 21:51:15.236 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225874&companyId=10141224&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2646
2026-01-12 21:51:17.363 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170220512?api_key=51job&timestamp=1768225877 status=200 resp_size=6226
2026-01-12 21:51:17.512 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225877&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:51:20.048 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162296304?api_key=51job&timestamp=1768225879 status=200 resp_size=6277
2026-01-12 21:51:20.215 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225880&companyId=8667276&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5578
2026-01-12 21:51:28.119 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170217915?api_key=51job&timestamp=1768225886 status=200 resp_size=6713
2026-01-12 21:51:28.355 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225888&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:51:32.058 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161498528?api_key=51job&timestamp=1768225891 status=200 resp_size=7173
2026-01-12 21:51:32.308 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225892&companyId=8667276&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5578
2026-01-12 21:51:40.242 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169143188?api_key=51job&timestamp=1768225899 status=200 resp_size=6550
2026-01-12 21:51:40.421 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225900&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4814
2026-01-12 21:51:44.055 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170138851?api_key=51job&timestamp=1768225903 status=200 resp_size=6194
2026-01-12 21:51:44.230 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225904&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:51:46.574 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161624911?api_key=51job&timestamp=1768225906 status=200 resp_size=7927
2026-01-12 21:51:46.759 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225906&companyId=8667276&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5578
2026-01-12 21:51:55.006 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170209275?api_key=51job&timestamp=1768225913 status=200 resp_size=5019
2026-01-12 21:51:55.672 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225915&companyId=10147480&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3084
2026-01-12 21:51:55.673 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 1 页数据，包含详细信息的数据条数: 20
2026-01-12 21:51:55.746 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 21:51:55.747 | INFO     | __main__:crawl_multiple_pages:1027 - 检测到API返回totalCount: 70 | 计算需要爬取: 4 页 (每页 20 条) | 预计最大数据: 80 条
2026-01-12 21:51:55.747 | INFO     | __main__:crawl_multiple_pages:1031 - 第 1 页获取到 20 个职位 | 累计: 20 个
2026-01-12 21:52:02.544 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 6.80 秒后继续...
2026-01-12 21:52:02.544 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 2/4 页...
2026-01-12 21:52:02.544 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:52:02.564 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=2, 页大小=20, 地区=110500, 工作类型=3111
2026-01-12 21:52:03.408 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:52:04.604 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:52:06.795 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:52:06.795 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:52:07.236 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768225922 status=200 resp_size=123445
2026-01-12 21:52:07.237 | INFO     | __main__:get_recommend_jobs:747 - 第 2 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 70 (原始值: 70) | 地区: 漳州(110500) | 职能: 商务专员(3111)
2026-01-12 21:52:07.466 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169818864?api_key=51job&timestamp=1768225927 status=200 resp_size=5494
2026-01-12 21:52:07.688 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225927&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
2026-01-12 21:52:19.750 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170160750?api_key=51job&timestamp=1768225937 status=200 resp_size=5961
2026-01-12 21:52:20.426 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225939&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:52:26.068 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162842434?api_key=51job&timestamp=1768225945 status=200 resp_size=6201
2026-01-12 21:52:26.246 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225946&companyId=8667276&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5578
2026-01-12 21:52:27.749 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169345173?api_key=51job&timestamp=1768225947 status=200 resp_size=7351
2026-01-12 21:52:27.938 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225947&companyId=7537623&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9097
2026-01-12 21:52:29.813 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170173982?api_key=51job&timestamp=1768225949 status=200 resp_size=5545
2026-01-12 21:52:29.980 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225949&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
2026-01-12 21:52:35.871 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170109443?api_key=51job&timestamp=1768225955 status=200 resp_size=5700
2026-01-12 21:52:36.084 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225955&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:52:43.076 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161905324?api_key=51job&timestamp=1768225962 status=200 resp_size=7364
2026-01-12 21:52:43.256 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225963&companyId=8667276&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5578
2026-01-12 21:52:46.727 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170048103?api_key=51job&timestamp=1768225966 status=200 resp_size=6503
2026-01-12 21:52:46.911 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225966&companyId=9953821&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2612
2026-01-12 21:52:54.566 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167439146?api_key=51job&timestamp=1768225973 status=200 resp_size=6126
2026-01-12 21:52:54.849 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225974&companyId=9868960&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4728
2026-01-12 21:53:04.504 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170139576?api_key=51job&timestamp=1768225982 status=200 resp_size=7643
2026-01-12 21:53:04.707 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225984&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:53:11.643 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161646908?api_key=51job&timestamp=1768225990 status=200 resp_size=6679
2026-01-12 21:53:11.863 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768225991&companyId=8667276&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5578
2026-01-12 21:53:23.336 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086169?api_key=51job&timestamp=1768225999 status=200 resp_size=5568
2026-01-12 21:53:23.561 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226003&companyId=10090180&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2848
2026-01-12 21:53:34.047 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169256898?api_key=51job&timestamp=1768226012 status=200 resp_size=6345
2026-01-12 21:53:34.338 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226014&companyId=10028121&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2934
2026-01-12 21:53:42.962 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170111509?api_key=51job&timestamp=1768226021 status=200 resp_size=6962
2026-01-12 21:53:43.292 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226022&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:53:47.894 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162142054?api_key=51job&timestamp=1768226027 status=200 resp_size=6533
2026-01-12 21:53:48.740 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226027&companyId=8667276&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5578
2026-01-12 21:53:51.175 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168094297?api_key=51job&timestamp=1768226030 status=200 resp_size=5867
2026-01-12 21:53:51.749 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226031&companyId=9827590&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3015
2026-01-12 21:53:56.481 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170079523?api_key=51job&timestamp=1768226036 status=200 resp_size=5799
2026-01-12 21:53:56.948 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226036&companyId=9987348&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3329
2026-01-12 21:53:59.999 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170132259?api_key=51job&timestamp=1768226039 status=200 resp_size=6389
2026-01-12 21:54:00.294 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226039&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:54:10.589 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161646421?api_key=51job&timestamp=1768226049 status=200 resp_size=6522
2026-01-12 21:54:10.766 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226050&companyId=8667276&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5578
2026-01-12 21:54:14.495 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170078239?api_key=51job&timestamp=1768226054 status=200 resp_size=5880
2026-01-12 21:54:14.673 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226054&companyId=10128402&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2626
2026-01-12 21:54:14.673 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 2 页数据，包含详细信息的数据条数: 20
2026-01-12 21:54:14.709 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 21:54:14.709 | INFO     | __main__:crawl_multiple_pages:1031 - 第 2 页获取到 20 个职位 | 累计: 40 个
2026-01-12 21:54:22.743 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 8.03 秒后继续...
2026-01-12 21:54:22.743 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 3/4 页...
2026-01-12 21:54:22.743 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:54:22.771 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=3, 页大小=20, 地区=110500, 工作类型=3111
2026-01-12 21:54:23.359 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:54:24.496 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:54:26.622 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:54:26.622 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:54:27.018 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768226062 status=200 resp_size=118417
2026-01-12 21:54:27.018 | INFO     | __main__:get_recommend_jobs:747 - 第 3 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 70 (原始值: 70) | 地区: 漳州(110500) | 职能: 商务专员(3111)
2026-01-12 21:54:27.186 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170188875?api_key=51job&timestamp=1768226067 status=200 resp_size=5391
2026-01-12 21:54:27.350 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226067&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
2026-01-12 21:54:35.217 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170183207?api_key=51job&timestamp=1768226074 status=200 resp_size=5680
2026-01-12 21:54:35.388 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226075&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:54:44.305 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161509282?api_key=51job&timestamp=1768226083 status=200 resp_size=6361
2026-01-12 21:54:45.658 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226084&companyId=9337943&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5056
2026-01-12 21:54:49.192 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168147253?api_key=51job&timestamp=1768226088 status=200 resp_size=6277
2026-01-12 21:54:50.771 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226089&companyId=9915300&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2916
2026-01-12 21:54:58.959 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167937928?api_key=51job&timestamp=1768226098 status=200 resp_size=5730
2026-01-12 21:54:59.133 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226098&companyId=8965902&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7240
2026-01-12 21:55:05.572 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170141771?api_key=51job&timestamp=1768226104 status=200 resp_size=6896
2026-01-12 21:55:05.795 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226105&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:55:13.456 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167177821?api_key=51job&timestamp=1768226112 status=200 resp_size=5682
2026-01-12 21:55:13.646 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226113&companyId=9872690&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5235
2026-01-12 21:55:22.657 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169555071?api_key=51job&timestamp=1768226121 status=200 resp_size=6379
2026-01-12 21:55:22.889 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226122&companyId=9310196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2599
2026-01-12 21:55:30.586 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168376489?api_key=51job&timestamp=1768226129 status=200 resp_size=7227
2026-01-12 21:55:30.843 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226130&companyId=6966653&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3852
2026-01-12 21:55:37.727 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170132102?api_key=51job&timestamp=1768226137 status=200 resp_size=6291
2026-01-12 21:55:37.887 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226137&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:55:48.052 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169130919?api_key=51job&timestamp=1768226147 status=200 resp_size=5562
2026-01-12 21:55:48.270 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226148&companyId=10035656&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2776
2026-01-12 21:55:50.133 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169638608?api_key=51job&timestamp=1768226149 status=200 resp_size=4432
2026-01-12 21:55:50.352 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226150&companyId=10092670&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3181
2026-01-12 21:55:54.428 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168560095?api_key=51job&timestamp=1768226154 status=200 resp_size=6385
2026-01-12 21:55:54.632 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226154&companyId=9974974&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2638
2026-01-12 21:56:01.734 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170131857?api_key=51job&timestamp=1768226161 status=200 resp_size=6262
2026-01-12 21:56:01.874 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226161&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:56:10.913 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162311179?api_key=51job&timestamp=1768226170 status=200 resp_size=6346
2026-01-12 21:56:11.069 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226170&companyId=8667276&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5578
2026-01-12 21:56:14.911 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170183615?api_key=51job&timestamp=1768226174 status=200 resp_size=5685
2026-01-12 21:56:15.053 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226174&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:56:16.470 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170184252?api_key=51job&timestamp=1768226176 status=200 resp_size=7233
2026-01-12 21:56:16.603 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226176&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:56:20.971 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163467846?api_key=51job&timestamp=1768226180 status=200 resp_size=6423
2026-01-12 21:56:21.111 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226180&companyId=8667276&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5578
2026-01-12 21:56:23.966 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170164986?api_key=51job&timestamp=1768226183 status=200 resp_size=6485
2026-01-12 21:56:24.113 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226183&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:56:31.149 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170131125?api_key=51job&timestamp=1768226190 status=200 resp_size=6233
2026-01-12 21:56:31.440 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226191&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:56:31.440 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 3 页数据，包含详细信息的数据条数: 20
2026-01-12 21:56:39.673 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 21:56:39.674 | INFO     | __main__:crawl_multiple_pages:1031 - 第 3 页获取到 20 个职位 | 累计: 60 个
2026-01-12 21:56:47.598 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 7.92 秒后继续...
2026-01-12 21:56:47.598 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 4/4 页...
2026-01-12 21:56:47.598 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:56:47.619 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=4, 页大小=20, 地区=110500, 工作类型=3111
2026-01-12 21:56:48.416 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:56:49.606 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:56:52.177 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:56:52.177 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:56:52.817 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768226207 status=200 resp_size=62234
2026-01-12 21:56:52.817 | INFO     | __main__:get_recommend_jobs:747 - 第 4 页成功获取 10 个职位（去重后: 10） | API返回totalCount: 70 (原始值: 70) | 地区: 漳州(110500) | 职能: 商务专员(3111)
2026-01-12 21:56:53.135 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170165409?api_key=51job&timestamp=1768226212 status=200 resp_size=6663
2026-01-12 21:56:53.358 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226213&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:56:58.405 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170110782?api_key=51job&timestamp=1768226218 status=200 resp_size=6393
2026-01-12 21:56:59.045 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226218&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:57:05.426 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170153269?api_key=51job&timestamp=1768226224 status=200 resp_size=7617
2026-01-12 21:57:05.742 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226225&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:57:13.935 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170186727?api_key=51job&timestamp=1768226232 status=200 resp_size=7298
2026-01-12 21:57:14.211 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226233&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:57:22.411 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170131334?api_key=51job&timestamp=1768226241 status=200 resp_size=6647
2026-01-12 21:57:22.631 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226242&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:57:31.075 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170160626?api_key=51job&timestamp=1768226250 status=200 resp_size=6481
2026-01-12 21:57:31.281 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226251&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:57:38.557 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170131282?api_key=51job&timestamp=1768226257 status=200 resp_size=6597
2026-01-12 21:57:38.757 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226258&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:57:43.458 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170163037?api_key=51job&timestamp=1768226263 status=200 resp_size=6255
2026-01-12 21:57:43.663 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226263&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:57:45.501 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170184193?api_key=51job&timestamp=1768226265 status=200 resp_size=7256
2026-01-12 21:57:45.721 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226265&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:57:49.414 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170165380?api_key=51job&timestamp=1768226269 status=200 resp_size=6744
2026-01-12 21:57:49.618 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226269&companyId=10133941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4751
2026-01-12 21:57:49.618 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 4 页数据，包含详细信息的数据条数: 10
2026-01-12 21:57:49.681 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 10, 响应大小: 113 字节
2026-01-12 21:57:49.681 | INFO     | __main__:crawl_multiple_pages:1031 - 第 4 页获取到 10 个职位 | 累计: 70 个
2026-01-12 21:57:49.681 | INFO     | __main__:crawl_multiple_pages:1039 - 已获取所有数据 (70/70)，提前结束爬取
2026-01-12 21:57:49.681 | INFO     | __main__:crawl_multiple_pages:1056 - 
================================================================================
2026-01-12 21:57:49.681 | INFO     | __main__:crawl_multiple_pages:1057 - 爬取统计信息:
2026-01-12 21:57:49.681 | INFO     | __main__:crawl_multiple_pages:1058 -   总抓取数量: 70 条
2026-01-12 21:57:49.681 | INFO     | __main__:crawl_multiple_pages:1059 -   去重后数量: 70 条
2026-01-12 21:57:49.681 | INFO     | __main__:crawl_multiple_pages:1060 -   重复数量: 0 条
2026-01-12 21:57:49.681 | INFO     | __main__:crawl_multiple_pages:1061 -   API返回totalCount: 70 条
2026-01-12 21:57:49.681 | INFO     | __main__:crawl_multiple_pages:1062 -   实际爬取页数: 4 页
2026-01-12 21:57:49.681 | INFO     | __main__:crawl_multiple_pages:1063 -   地区: 漳州(110500)
2026-01-12 21:57:49.681 | INFO     | __main__:crawl_multiple_pages:1064 -   职能: 商务专员(3111)
2026-01-12 21:57:49.681 | INFO     | __main__:crawl_multiple_pages:1067 -   覆盖率: 100.00% (70/70)
2026-01-12 21:57:49.681 | INFO     | __main__:crawl_multiple_pages:1072 - ================================================================================

2026-01-12 21:57:49.681 | INFO     | __main__:save_crawl_stats:131 - 统计信息已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_stats.log
2026-01-12 21:57:49.681 | INFO     | __main__:crawl_multiple_pages:1086 - 职位记录已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_jobs_records.log (共 70 条记录)
2026-01-12 21:57:49.681 | INFO     | __main__:crawl_recommend_jobs_main:1216 - 推荐职位爬取完成！共找到 70 个职位
2026-01-12 21:57:49.681 | INFO     | __main__:close:1137 - httpx客户端已关闭
2026-01-12 21:57:54.906 | INFO     | __main__:crawl_recommend_jobs_main:1170 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:57:54.917 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:57:55.012 | INFO     | __main__:crawl_recommend_jobs_main:1198 - 随机选择城市: 六安 (151200)
2026-01-12 21:57:55.012 | INFO     | __main__:crawl_recommend_jobs_main:1202 - 随机选择工作类型: 党工团干事 (2310)
2026-01-12 21:57:55.012 | INFO     | __main__:crawl_recommend_jobs_main:1204 - 开始爬取推荐职位，最多 50 页
2026-01-12 21:57:55.012 | INFO     | __main__:crawl_multiple_pages:1000 - ================================================================================
2026-01-12 21:57:55.012 | INFO     | __main__:crawl_multiple_pages:1001 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 六安(151200) | 职能: 党工团干事(2310)
2026-01-12 21:57:55.012 | INFO     | __main__:crawl_multiple_pages:1002 - ================================================================================
2026-01-12 21:57:55.012 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 1/50 页...
2026-01-12 21:57:55.012 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:57:55.059 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=1, 页大小=20, 地区=151200, 工作类型=2310
2026-01-12 21:57:56.006 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:57:57.147 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:57:59.261 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:57:59.261 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:57:59.677 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768226275 status=200 resp_size=120405
2026-01-12 21:57:59.678 | INFO     | __main__:get_recommend_jobs:747 - 第 1 页成功获取 18 个职位（去重后: 18） | API返回totalCount: 18 (原始值: 18) | 地区: 六安(151200) | 职能: 党工团干事(2310)
2026-01-12 21:58:00.171 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168755516?api_key=51job&timestamp=1768226279 status=200 resp_size=6655
2026-01-12 21:58:00.357 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226280&companyId=9325380&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3090
2026-01-12 21:58:07.684 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164269222?api_key=51job&timestamp=1768226287 status=200 resp_size=6959
2026-01-12 21:58:07.841 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226287&companyId=7640642&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3797
2026-01-12 21:58:15.280 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166519478?api_key=51job&timestamp=1768226293 status=200 resp_size=5510
2026-01-12 21:58:15.850 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226295&companyId=9816763&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-12 21:58:17.233 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159348703?api_key=51job&timestamp=1768226296 status=200 resp_size=5314
2026-01-12 21:58:17.488 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226297&companyId=9157456&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2678
2026-01-12 21:58:20.537 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169563891?api_key=51job&timestamp=1768226299 status=200 resp_size=7042
2026-01-12 21:58:21.006 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226300&companyId=8199797&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9586
2026-01-12 21:58:29.136 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/150177353?api_key=51job&timestamp=1768226306 status=200 resp_size=6010
2026-01-12 21:58:31.311 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226309&companyId=4927060&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10278
2026-01-12 21:58:34.877 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169301030?api_key=51job&timestamp=1768226314 status=200 resp_size=6997
2026-01-12 21:58:35.209 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226314&companyId=8199797&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9586
2026-01-12 21:58:39.565 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165696377?api_key=51job&timestamp=1768226318 status=200 resp_size=7078
2026-01-12 21:58:39.855 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226319&companyId=9414151&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4971
2026-01-12 21:58:49.741 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168376978?api_key=51job&timestamp=1768226329 status=200 resp_size=7227
2026-01-12 21:58:49.898 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226329&companyId=6966653&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3852
2026-01-12 21:58:52.372 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170048026?api_key=51job&timestamp=1768226332 status=200 resp_size=6503
2026-01-12 21:58:52.514 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226332&companyId=9953821&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2612
2026-01-12 21:59:01.430 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170079479?api_key=51job&timestamp=1768226339 status=200 resp_size=5799
2026-01-12 21:59:01.618 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226341&companyId=9987348&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3329
2026-01-12 21:59:07.592 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161655823?api_key=51job&timestamp=1768226346 status=200 resp_size=6353
2026-01-12 21:59:07.743 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226347&companyId=9337943&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5056
2026-01-12 21:59:09.252 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169745285?api_key=51job&timestamp=1768226349 status=200 resp_size=7163
2026-01-12 21:59:09.408 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226349&companyId=10016288&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5913
2026-01-12 21:59:19.620 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169827686?api_key=51job&timestamp=1768226358 status=200 resp_size=4409
2026-01-12 21:59:19.851 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226359&companyId=10110765&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3208
2026-01-12 21:59:28.625 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162563417?api_key=51job&timestamp=1768226367 status=200 resp_size=4772
2026-01-12 21:59:28.923 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226368&companyId=4332821&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9331
2026-01-12 21:59:30.810 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146156625?api_key=51job&timestamp=1768226370 status=200 resp_size=5501
2026-01-12 21:59:31.065 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226370&companyId=4225876&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7322
2026-01-12 21:59:41.787 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168755415?api_key=51job&timestamp=1768226380 status=200 resp_size=6626
2026-01-12 21:59:42.034 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226381&companyId=9325380&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3090
2026-01-12 21:59:44.625 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169355251?api_key=51job&timestamp=1768226384 status=200 resp_size=6550
2026-01-12 21:59:44.885 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226384&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4814
2026-01-12 21:59:44.885 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 1 页数据，包含详细信息的数据条数: 18
2026-01-12 21:59:44.924 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 18, 响应大小: 113 字节
2026-01-12 21:59:44.924 | INFO     | __main__:crawl_multiple_pages:1027 - 检测到API返回totalCount: 18 | 计算需要爬取: 1 页 (每页 20 条) | 预计最大数据: 20 条
2026-01-12 21:59:44.924 | INFO     | __main__:crawl_multiple_pages:1031 - 第 1 页获取到 18 个职位 | 累计: 18 个
2026-01-12 21:59:44.924 | INFO     | __main__:crawl_multiple_pages:1039 - 已获取所有数据 (18/18)，提前结束爬取
2026-01-12 21:59:44.925 | INFO     | __main__:crawl_multiple_pages:1056 - 
================================================================================
2026-01-12 21:59:44.925 | INFO     | __main__:crawl_multiple_pages:1057 - 爬取统计信息:
2026-01-12 21:59:44.925 | INFO     | __main__:crawl_multiple_pages:1058 -   总抓取数量: 18 条
2026-01-12 21:59:44.925 | INFO     | __main__:crawl_multiple_pages:1059 -   去重后数量: 18 条
2026-01-12 21:59:44.925 | INFO     | __main__:crawl_multiple_pages:1060 -   重复数量: 0 条
2026-01-12 21:59:44.925 | INFO     | __main__:crawl_multiple_pages:1061 -   API返回totalCount: 18 条
2026-01-12 21:59:44.925 | INFO     | __main__:crawl_multiple_pages:1062 -   实际爬取页数: 1 页
2026-01-12 21:59:44.925 | INFO     | __main__:crawl_multiple_pages:1063 -   地区: 六安(151200)
2026-01-12 21:59:44.925 | INFO     | __main__:crawl_multiple_pages:1064 -   职能: 党工团干事(2310)
2026-01-12 21:59:44.925 | INFO     | __main__:crawl_multiple_pages:1067 -   覆盖率: 100.00% (18/18)
2026-01-12 21:59:44.925 | INFO     | __main__:crawl_multiple_pages:1072 - ================================================================================

2026-01-12 21:59:44.926 | INFO     | __main__:save_crawl_stats:131 - 统计信息已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_stats.log
2026-01-12 21:59:44.926 | INFO     | __main__:crawl_multiple_pages:1086 - 职位记录已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_jobs_records.log (共 18 条记录)
2026-01-12 21:59:44.926 | INFO     | __main__:crawl_recommend_jobs_main:1216 - 推荐职位爬取完成！共找到 18 个职位
2026-01-12 21:59:44.926 | INFO     | __main__:close:1137 - httpx客户端已关闭
2026-01-12 21:59:51.866 | INFO     | __main__:crawl_recommend_jobs_main:1170 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:59:51.881 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:59:51.909 | INFO     | __main__:crawl_recommend_jobs_main:1198 - 随机选择城市: 河源 (32100)
2026-01-12 21:59:51.911 | INFO     | __main__:crawl_recommend_jobs_main:1202 - 随机选择工作类型: 高级硬件工程师 (2956)
2026-01-12 21:59:51.911 | INFO     | __main__:crawl_recommend_jobs_main:1204 - 开始爬取推荐职位，最多 50 页
2026-01-12 21:59:51.911 | INFO     | __main__:crawl_multiple_pages:1000 - ================================================================================
2026-01-12 21:59:51.911 | INFO     | __main__:crawl_multiple_pages:1001 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 21:59:51.911 | INFO     | __main__:crawl_multiple_pages:1002 - ================================================================================
2026-01-12 21:59:51.911 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 1/50 页...
2026-01-12 21:59:51.911 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 21:59:51.925 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=1, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 21:59:52.694 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:59:53.891 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:59:56.074 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 21:59:56.074 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 21:59:56.634 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768226391 status=200 resp_size=124061
2026-01-12 21:59:56.634 | INFO     | __main__:get_recommend_jobs:747 - 第 1 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 21:59:56.886 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167971991?api_key=51job&timestamp=1768226396 status=200 resp_size=5976
2026-01-12 21:59:57.119 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226396&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7845
2026-01-12 22:00:06.508 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160369868?api_key=51job&timestamp=1768226405 status=200 resp_size=5583
2026-01-12 22:00:06.727 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226406&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-12 22:00:13.291 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160371871?api_key=51job&timestamp=1768226412 status=200 resp_size=5188
2026-01-12 22:00:13.474 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226413&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-12 22:00:21.148 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370126?api_key=51job&timestamp=1768226419 status=200 resp_size=5634
2026-01-12 22:00:21.367 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226421&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-12 22:00:25.090 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170204019?api_key=51job&timestamp=1768226424 status=200 resp_size=6332
2026-01-12 22:00:25.307 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226425&companyId=5310383&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10138
2026-01-12 22:00:31.660 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370349?api_key=51job&timestamp=1768226430 status=200 resp_size=5550
2026-01-12 22:00:32.041 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226431&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-12 22:00:37.181 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170180102?api_key=51job&timestamp=1768226436 status=200 resp_size=5175
2026-01-12 22:00:37.509 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226437&companyId=10108008&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3416
2026-01-12 22:00:48.929 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158771407?api_key=51job&timestamp=1768226446 status=200 resp_size=8637
2026-01-12 22:00:49.504 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226448&companyId=2928943&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8069
2026-01-12 22:00:53.637 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170231408?api_key=51job&timestamp=1768226452 status=200 resp_size=6170
2026-01-12 22:00:54.989 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226453&companyId=6883541&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=15527
2026-01-12 22:01:05.498 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169411076?api_key=51job&timestamp=1768226464 status=200 resp_size=6609
2026-01-12 22:01:05.717 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226465&companyId=9786290&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3407
2026-01-12 22:01:13.097 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161323778?api_key=51job&timestamp=1768226471 status=200 resp_size=5893
2026-01-12 22:01:13.365 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226473&companyId=5277541&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5138
2026-01-12 22:01:17.844 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170102899?api_key=51job&timestamp=1768226477 status=200 resp_size=6056
2026-01-12 22:01:18.078 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226477&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-12 22:01:25.202 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804396?api_key=51job&timestamp=1768226484 status=200 resp_size=6417
2026-01-12 22:01:25.410 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226485&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:01:33.055 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163138192?api_key=51job&timestamp=1768226491 status=200 resp_size=5813
2026-01-12 22:01:33.269 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226493&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 22:01:35.742 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161941101?api_key=51job&timestamp=1768226495 status=200 resp_size=4916
2026-01-12 22:01:36.048 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226495&companyId=9330961&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3292
2026-01-12 22:01:46.589 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126563?api_key=51job&timestamp=1768226504 status=200 resp_size=6081
2026-01-12 22:01:46.841 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226506&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-12 22:01:49.521 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170076491?api_key=51job&timestamp=1768226509 status=200 resp_size=6980
2026-01-12 22:01:49.749 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226509&companyId=2429099&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6736
2026-01-12 22:01:57.127 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167300668?api_key=51job&timestamp=1768226516 status=200 resp_size=7054
2026-01-12 22:01:57.312 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226517&companyId=8383779&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
2026-01-12 22:02:04.633 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164959350?api_key=51job&timestamp=1768226523 status=200 resp_size=5738
2026-01-12 22:02:04.784 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226524&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 22:02:06.476 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158438599?api_key=51job&timestamp=1768226526 status=200 resp_size=5476
2026-01-12 22:02:06.671 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226526&companyId=8059756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6355
2026-01-12 22:02:06.671 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 1 页数据，包含详细信息的数据条数: 20
2026-01-12 22:02:06.718 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:02:06.718 | INFO     | __main__:crawl_multiple_pages:1027 - 检测到API返回totalCount: 501 | 计算需要爬取: 26 页 (每页 20 条) | 预计最大数据: 520 条
2026-01-12 22:02:06.718 | INFO     | __main__:crawl_multiple_pages:1031 - 第 1 页获取到 20 个职位 | 累计: 20 个
2026-01-12 22:02:10.347 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 3.63 秒后继续...
2026-01-12 22:02:10.347 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 2/26 页...
2026-01-12 22:02:10.348 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:02:10.369 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=2, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:02:11.163 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:02:12.357 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:02:14.544 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:02:14.544 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:02:15.078 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768226530 status=200 resp_size=112004
2026-01-12 22:02:15.078 | INFO     | __main__:get_recommend_jobs:747 - 第 2 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:02:15.315 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050033?api_key=51job&timestamp=1768226535 status=200 resp_size=6037
2026-01-12 22:02:15.524 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226535&companyId=10126395&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2865
2026-01-12 22:02:19.358 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169175063?api_key=51job&timestamp=1768226539 status=200 resp_size=6268
2026-01-12 22:02:19.583 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226539&companyId=10007015&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5841
2026-01-12 22:02:30.209 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167697904?api_key=51job&timestamp=1768226549 status=200 resp_size=5738
2026-01-12 22:02:30.436 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226550&companyId=9502700&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3664
2026-01-12 22:02:41.136 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163080620?api_key=51job&timestamp=1768226559 status=200 resp_size=5638
2026-01-12 22:02:41.395 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226561&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 22:02:51.604 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170208755?api_key=51job&timestamp=1768226570 status=200 resp_size=6386
2026-01-12 22:02:51.894 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226571&companyId=10101579&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3029
2026-01-12 22:02:54.698 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170132288?api_key=51job&timestamp=1768226574 status=200 resp_size=5098
2026-01-12 22:02:54.934 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226574&companyId=10140534&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 22:02:59.861 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165612676?api_key=51job&timestamp=1768226579 status=200 resp_size=6273
2026-01-12 22:03:00.126 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226579&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4814
2026-01-12 22:03:04.129 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160041583?api_key=51job&timestamp=1768226583 status=200 resp_size=5373
2026-01-12 22:03:04.355 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226584&companyId=8395725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3112
2026-01-12 22:03:11.551 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167368039?api_key=51job&timestamp=1768226590 status=200 resp_size=6433
2026-01-12 22:03:11.720 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226591&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-12 22:03:21.084 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165890498?api_key=51job&timestamp=1768226600 status=200 resp_size=5186
2026-01-12 22:03:21.285 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226601&companyId=9771350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6796
2026-01-12 22:03:24.576 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168858074?api_key=51job&timestamp=1768226604 status=200 resp_size=5022
2026-01-12 22:03:24.782 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226604&companyId=9520344&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2988
2026-01-12 22:03:33.226 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159683606?api_key=51job&timestamp=1768226612 status=200 resp_size=6134
2026-01-12 22:03:33.434 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226613&companyId=8006731&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2565
2026-01-12 22:03:37.087 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323849?api_key=51job&timestamp=1768226616 status=200 resp_size=7193
2026-01-12 22:03:37.329 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226617&companyId=8899718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8455
2026-01-12 22:03:40.155 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160078565?api_key=51job&timestamp=1768226619 status=200 resp_size=5612
2026-01-12 22:03:40.356 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226620&companyId=9199595&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3460
2026-01-12 22:03:47.953 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166840546?api_key=51job&timestamp=1768226627 status=200 resp_size=5128
2026-01-12 22:03:48.165 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226627&companyId=9248576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2692
2026-01-12 22:03:55.154 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166855655?api_key=51job&timestamp=1768226634 status=200 resp_size=5970
2026-01-12 22:03:55.310 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226635&companyId=9551781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2660
2026-01-12 22:04:02.090 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170114968?api_key=51job&timestamp=1768226641 status=200 resp_size=6322
2026-01-12 22:04:02.677 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226642&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
2026-01-12 22:04:10.708 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166173609?api_key=51job&timestamp=1768226649 status=200 resp_size=5623
2026-01-12 22:04:10.885 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226650&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-12 22:04:20.505 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041266?api_key=51job&timestamp=1768226659 status=200 resp_size=5839
2026-01-12 22:04:20.648 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226660&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 22:04:28.491 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170093398?api_key=51job&timestamp=1768226666 status=200 resp_size=5407
2026-01-12 22:04:28.840 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226668&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-12 22:04:28.840 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 2 页数据，包含详细信息的数据条数: 20
2026-01-12 22:04:28.866 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:04:28.866 | INFO     | __main__:crawl_multiple_pages:1031 - 第 2 页获取到 20 个职位 | 累计: 40 个
2026-01-12 22:04:31.818 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 2.95 秒后继续...
2026-01-12 22:04:31.818 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 3/26 页...
2026-01-12 22:04:31.819 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:04:31.838 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=3, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:04:33.352 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:04:35.643 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:04:38.060 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:04:38.060 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:04:39.261 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768226671 status=200 resp_size=110362
2026-01-12 22:04:39.262 | INFO     | __main__:get_recommend_jobs:747 - 第 3 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:04:39.611 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169609507?api_key=51job&timestamp=1768226679 status=200 resp_size=5902
2026-01-12 22:04:39.849 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226679&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:04:44.595 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168253127?api_key=51job&timestamp=1768226684 status=200 resp_size=5619
2026-01-12 22:04:45.014 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226684&companyId=9848116&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3803
2026-01-12 22:04:54.537 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166113366?api_key=51job&timestamp=1768226693 status=200 resp_size=5704
2026-01-12 22:04:54.747 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226694&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-12 22:05:04.976 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166179432?api_key=51job&timestamp=1768226702 status=200 resp_size=5612
2026-01-12 22:05:05.205 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226704&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-12 22:05:12.451 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169652013?api_key=51job&timestamp=1768226711 status=200 resp_size=6336
2026-01-12 22:05:12.681 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226712&companyId=5882528&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7948
2026-01-12 22:05:16.604 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322119?api_key=51job&timestamp=1768226716 status=200 resp_size=6499
2026-01-12 22:05:16.825 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226716&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-12 22:05:18.631 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166519728?api_key=51job&timestamp=1768226718 status=200 resp_size=5519
2026-01-12 22:05:18.844 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226718&companyId=9816763&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-12 22:05:22.635 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041305?api_key=51job&timestamp=1768226722 status=200 resp_size=5799
2026-01-12 22:05:22.854 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226722&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 22:05:31.812 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169657873?api_key=51job&timestamp=1768226731 status=200 resp_size=6452
2026-01-12 22:05:31.990 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226731&companyId=10094056&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6505
2026-01-12 22:05:35.641 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167246198?api_key=51job&timestamp=1768226735 status=200 resp_size=5684
2026-01-12 22:05:35.809 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226735&companyId=9856387&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3703
2026-01-12 22:05:43.184 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166822227?api_key=51job&timestamp=1768226741 status=200 resp_size=6307
2026-01-12 22:05:43.469 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226743&companyId=9210539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3106
2026-01-12 22:05:47.582 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161788718?api_key=51job&timestamp=1768226747 status=200 resp_size=5148
2026-01-12 22:05:48.008 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226747&companyId=9366134&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3620
2026-01-12 22:05:51.083 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447969?api_key=51job&timestamp=1768226750 status=200 resp_size=5748
2026-01-12 22:05:52.009 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226751&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:06:01.794 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041169?api_key=51job&timestamp=1768226759 status=200 resp_size=5967
2026-01-12 22:06:02.132 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226761&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 22:06:08.420 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322023?api_key=51job&timestamp=1768226767 status=200 resp_size=5836
2026-01-12 22:06:08.601 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226768&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-12 22:06:13.460 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163273848?api_key=51job&timestamp=1768226773 status=200 resp_size=5179
2026-01-12 22:06:13.625 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226773&companyId=9043175&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2725
2026-01-12 22:06:15.555 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170200018?api_key=51job&timestamp=1768226775 status=200 resp_size=8501
2026-01-12 22:06:15.724 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226775&companyId=9861992&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4825
2026-01-12 22:06:17.669 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158054032?api_key=51job&timestamp=1768226777 status=200 resp_size=6003
2026-01-12 22:06:17.864 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226777&companyId=9057358&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2681
2026-01-12 22:06:26.050 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857801?api_key=51job&timestamp=1768226784 status=200 resp_size=6055
2026-01-12 22:06:26.274 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226786&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 22:06:33.743 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166174784?api_key=51job&timestamp=1768226792 status=200 resp_size=5351
2026-01-12 22:06:33.952 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226793&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-12 22:06:33.953 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 3 页数据，包含详细信息的数据条数: 20
2026-01-12 22:06:33.989 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:06:33.989 | INFO     | __main__:crawl_multiple_pages:1031 - 第 3 页获取到 20 个职位 | 累计: 60 个
2026-01-12 22:06:43.726 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 9.73 秒后继续...
2026-01-12 22:06:43.726 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 4/26 页...
2026-01-12 22:06:43.726 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:06:43.756 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=4, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:06:44.594 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:06:45.786 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:06:47.961 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:06:47.961 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:06:48.485 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768226803 status=200 resp_size=120371
2026-01-12 22:06:48.486 | INFO     | __main__:get_recommend_jobs:747 - 第 4 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:06:48.753 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169079604?api_key=51job&timestamp=1768226808 status=200 resp_size=5295
2026-01-12 22:06:49.018 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226808&companyId=2861122&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4822
2026-01-12 22:06:57.716 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158370406?api_key=51job&timestamp=1768226816 status=200 resp_size=5734
2026-01-12 22:06:57.925 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226817&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-12 22:07:02.076 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126251?api_key=51job&timestamp=1768226821 status=200 resp_size=5762
2026-01-12 22:07:02.690 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226822&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-12 22:07:12.915 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954416?api_key=51job&timestamp=1768226832 status=200 resp_size=5946
2026-01-12 22:07:13.129 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226832&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 22:07:20.029 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169555046?api_key=51job&timestamp=1768226839 status=200 resp_size=5464
2026-01-12 22:07:20.349 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226840&companyId=6453633&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7496
2026-01-12 22:07:24.704 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166111168?api_key=51job&timestamp=1768226844 status=200 resp_size=5733
2026-01-12 22:07:24.954 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226844&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-12 22:07:28.018 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163285553?api_key=51job&timestamp=1768226847 status=200 resp_size=6158
2026-01-12 22:07:28.245 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226848&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-12 22:07:40.530 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161093063?api_key=51job&timestamp=1768226857 status=200 resp_size=4899
2026-01-12 22:07:40.807 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226860&companyId=9298193&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2762
2026-01-12 22:07:42.500 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169107661?api_key=51job&timestamp=1768226862 status=200 resp_size=6884
2026-01-12 22:07:42.825 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226862&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:07:53.488 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954338?api_key=51job&timestamp=1768226872 status=200 resp_size=5238
2026-01-12 22:07:53.678 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226873&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 22:08:01.181 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167930682?api_key=51job&timestamp=1768226880 status=200 resp_size=6030
2026-01-12 22:08:01.451 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226881&companyId=6966653&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3852
2026-01-12 22:08:05.530 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163286165?api_key=51job&timestamp=1768226883 status=200 resp_size=5488
2026-01-12 22:08:06.190 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226885&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-12 22:08:16.523 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153297297?api_key=51job&timestamp=1768226895 status=200 resp_size=5925
2026-01-12 22:08:16.701 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226896&companyId=13201&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10777
2026-01-12 22:08:21.661 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170097130?api_key=51job&timestamp=1768226900 status=200 resp_size=5278
2026-01-12 22:08:21.849 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226901&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-12 22:08:34.283 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954601?api_key=51job&timestamp=1768226907 status=200 resp_size=5640
2026-01-12 22:08:35.277 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226914&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 22:08:44.893 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857296?api_key=51job&timestamp=1768226923 status=200 resp_size=5894
2026-01-12 22:08:45.118 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226924&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 22:08:54.251 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167867265?api_key=51job&timestamp=1768226932 status=200 resp_size=7780
2026-01-12 22:08:54.545 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226934&companyId=5713012&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11344
2026-01-12 22:09:05.046 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166890851?api_key=51job&timestamp=1768226944 status=200 resp_size=6669
2026-01-12 22:09:05.246 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226945&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8122
2026-01-12 22:09:07.479 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165259347?api_key=51job&timestamp=1768226947 status=200 resp_size=4201
2026-01-12 22:09:07.657 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226947&companyId=148020&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7420
2026-01-12 22:09:17.705 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166865703?api_key=51job&timestamp=1768226956 status=200 resp_size=6444
2026-01-12 22:09:18.540 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226957&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8122
2026-01-12 22:09:18.540 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 4 页数据，包含详细信息的数据条数: 20
2026-01-12 22:09:18.574 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:09:18.574 | INFO     | __main__:crawl_multiple_pages:1031 - 第 4 页获取到 20 个职位 | 累计: 80 个
2026-01-12 22:09:27.045 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 8.47 秒后继续...
2026-01-12 22:09:27.045 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 5/26 页...
2026-01-12 22:09:27.046 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:09:27.090 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=5, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:09:27.814 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:09:28.981 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:09:31.151 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:09:31.151 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:09:31.622 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768226967 status=200 resp_size=125601
2026-01-12 22:09:31.623 | INFO     | __main__:get_recommend_jobs:747 - 第 5 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:09:31.857 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170002057?api_key=51job&timestamp=1768226971 status=200 resp_size=6070
2026-01-12 22:09:32.075 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226971&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:09:38.417 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163795744?api_key=51job&timestamp=1768226977 status=200 resp_size=6201
2026-01-12 22:09:38.635 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226978&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
2026-01-12 22:09:46.372 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166894628?api_key=51job&timestamp=1768226985 status=200 resp_size=6410
2026-01-12 22:09:46.612 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226986&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8122
2026-01-12 22:09:49.485 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166339728?api_key=51job&timestamp=1768226989 status=200 resp_size=6079
2026-01-12 22:09:49.793 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768226989&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
2026-01-12 22:10:00.024 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142783157?api_key=51job&timestamp=1768226999 status=200 resp_size=6874
2026-01-12 22:10:00.193 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227000&companyId=4284907&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8133
2026-01-12 22:10:09.108 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166888109?api_key=51job&timestamp=1768227008 status=200 resp_size=6551
2026-01-12 22:10:09.340 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227009&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8122
2026-01-12 22:10:10.849 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169552998?api_key=51job&timestamp=1768227010 status=200 resp_size=5859
2026-01-12 22:10:11.063 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227010&companyId=10081630&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2698
2026-01-12 22:10:14.913 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126632?api_key=51job&timestamp=1768227014 status=200 resp_size=5923
2026-01-12 22:10:15.179 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227014&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-12 22:10:25.685 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167749069?api_key=51job&timestamp=1768227024 status=200 resp_size=6231
2026-01-12 22:10:25.930 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227025&companyId=296713&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7824
2026-01-12 22:10:32.796 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170210409?api_key=51job&timestamp=1768227032 status=200 resp_size=5508
2026-01-12 22:10:32.960 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227032&companyId=10143440&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2501
2026-01-12 22:10:36.531 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170129561?api_key=51job&timestamp=1768227036 status=200 resp_size=9214
2026-01-12 22:10:36.714 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227036&companyId=2541073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12832
2026-01-12 22:10:44.876 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755292?api_key=51job&timestamp=1768227043 status=200 resp_size=6491
2026-01-12 22:10:45.099 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227044&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:10:48.242 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170128290?api_key=51job&timestamp=1768227047 status=200 resp_size=10186
2026-01-12 22:10:48.462 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227048&companyId=5844795&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5637
2026-01-12 22:10:51.094 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163897479?api_key=51job&timestamp=1768227050 status=200 resp_size=7105
2026-01-12 22:10:51.329 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227051&companyId=2501599&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5304
2026-01-12 22:11:01.432 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/134935273?api_key=51job&timestamp=1768227060 status=200 resp_size=9049
2026-01-12 22:11:01.683 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227061&companyId=2265313&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7521
2026-01-12 22:11:05.306 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169851423?api_key=51job&timestamp=1768227065 status=200 resp_size=6788
2026-01-12 22:11:05.478 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227065&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:11:08.094 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169604659?api_key=51job&timestamp=1768227067 status=200 resp_size=7166
2026-01-12 22:11:08.333 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227068&companyId=2016195&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4559
2026-01-12 22:11:13.423 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170017735?api_key=51job&timestamp=1768227073 status=200 resp_size=6257
2026-01-12 22:11:13.643 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227073&companyId=10126395&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2865
2026-01-12 22:11:16.045 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169935993?api_key=51job&timestamp=1768227075 status=200 resp_size=6591
2026-01-12 22:11:16.310 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227076&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
2026-01-12 22:11:26.475 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170147815?api_key=51job&timestamp=1768227085 status=200 resp_size=5439
2026-01-12 22:11:26.705 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227086&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:11:26.705 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 5 页数据，包含详细信息的数据条数: 20
2026-01-12 22:11:26.766 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:11:26.767 | INFO     | __main__:crawl_multiple_pages:1031 - 第 5 页获取到 20 个职位 | 累计: 100 个
2026-01-12 22:11:27.860 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 1.09 秒后继续...
2026-01-12 22:11:27.860 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 6/26 页...
2026-01-12 22:11:27.860 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:11:27.883 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=6, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:11:32.290 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:11:33.513 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:11:36.333 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:11:36.333 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:11:37.787 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768227087 status=200 resp_size=161750
2026-01-12 22:11:37.788 | INFO     | __main__:get_recommend_jobs:747 - 第 6 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:11:39.460 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/130474917?api_key=51job&timestamp=1768227097 status=200 resp_size=6749
2026-01-12 22:11:39.764 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227099&companyId=6144374&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7123
2026-01-12 22:11:47.023 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169927328?api_key=51job&timestamp=1768227103 status=200 resp_size=9189
2026-01-12 22:11:47.422 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227107&companyId=1451330&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7271
2026-01-12 22:11:48.958 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168021501?api_key=51job&timestamp=1768227108 status=200 resp_size=5735
2026-01-12 22:11:49.306 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227108&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
2026-01-12 22:11:56.610 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168708377?api_key=51job&timestamp=1768227115 status=200 resp_size=5709
2026-01-12 22:11:56.954 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227116&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:12:13.677 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159347190?api_key=51job&timestamp=1768227126 status=200 resp_size=5262
2026-01-12 22:12:14.985 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227133&companyId=3888892&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12331
2026-01-12 22:12:25.308 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169855968?api_key=51job&timestamp=1768227142 status=200 resp_size=6074
2026-01-12 22:12:27.075 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227145&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
2026-01-12 22:12:29.735 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170167516?api_key=51job&timestamp=1768227149 status=200 resp_size=6493
2026-01-12 22:12:30.056 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227149&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
2026-01-12 22:12:39.448 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755029?api_key=51job&timestamp=1768227158 status=200 resp_size=7002
2026-01-12 22:12:39.770 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227159&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:12:46.754 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170018599?api_key=51job&timestamp=1768227166 status=200 resp_size=6937
2026-01-12 22:12:47.018 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227166&companyId=323725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6484
2026-01-12 22:12:55.485 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/66521396?api_key=51job&timestamp=1768227174 status=200 resp_size=6694
2026-01-12 22:12:55.710 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227175&companyId=3220556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5999
2026-01-12 22:13:05.614 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169860176?api_key=51job&timestamp=1768227184 status=200 resp_size=6598
2026-01-12 22:13:05.892 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227185&companyId=1128753&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9600
2026-01-12 22:13:11.844 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170158528?api_key=51job&timestamp=1768227191 status=200 resp_size=6570
2026-01-12 22:13:12.134 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227191&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:13:16.004 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169259937?api_key=51job&timestamp=1768227195 status=200 resp_size=5729
2026-01-12 22:13:16.206 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227196&companyId=5777317&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7920
2026-01-12 22:13:19.107 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146679050?api_key=51job&timestamp=1768227198 status=200 resp_size=7569
2026-01-12 22:13:19.320 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227199&companyId=5726042&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5894
2026-01-12 22:13:28.178 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170129464?api_key=51job&timestamp=1768227205 status=200 resp_size=8602
2026-01-12 22:13:28.503 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227208&companyId=2541073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12832
2026-01-12 22:13:31.893 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447992?api_key=51job&timestamp=1768227211 status=200 resp_size=5519
2026-01-12 22:13:32.149 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227211&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:13:34.759 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168488694?api_key=51job&timestamp=1768227214 status=200 resp_size=6853
2026-01-12 22:13:34.963 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227214&companyId=2036019&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4474
2026-01-12 22:13:42.126 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169856264?api_key=51job&timestamp=1768227221 status=200 resp_size=5916
2026-01-12 22:13:42.363 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227222&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
2026-01-12 22:13:52.266 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170139062?api_key=51job&timestamp=1768227231 status=200 resp_size=7778
2026-01-12 22:13:52.471 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227232&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
2026-01-12 22:13:56.057 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170173478?api_key=51job&timestamp=1768227235 status=200 resp_size=6707
2026-01-12 22:13:56.258 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227236&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:13:56.258 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 6 页数据，包含详细信息的数据条数: 20
2026-01-12 22:13:56.339 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:13:56.339 | INFO     | __main__:crawl_multiple_pages:1031 - 第 6 页获取到 20 个职位 | 累计: 120 个
2026-01-12 22:14:02.058 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 5.72 秒后继续...
2026-01-12 22:14:02.058 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 7/26 页...
2026-01-12 22:14:02.059 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:14:02.081 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=7, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:14:02.621 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:14:03.757 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:14:05.883 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:14:05.883 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:14:06.694 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768227242 status=200 resp_size=150170
2026-01-12 22:14:06.694 | WARNING  | __main__:get_recommend_jobs:745 - 第 7 页发现 1 个重复职位（已跳过）
2026-01-12 22:14:06.694 | INFO     | __main__:get_recommend_jobs:747 - 第 7 页成功获取 20 个职位（去重后: 19） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:14:06.884 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169698421?api_key=51job&timestamp=1768227246 status=200 resp_size=7212
2026-01-12 22:14:07.045 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227246&companyId=10098645&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2735
2026-01-12 22:14:11.113 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170129002?api_key=51job&timestamp=1768227250 status=200 resp_size=9018
2026-01-12 22:14:11.312 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227251&companyId=2541073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12832
2026-01-12 22:14:15.372 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157376468?api_key=51job&timestamp=1768227255 status=200 resp_size=6732
2026-01-12 22:14:15.536 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227255&companyId=2297693&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10416
2026-01-12 22:14:19.481 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169950080?api_key=51job&timestamp=1768227259 status=200 resp_size=6302
2026-01-12 22:14:19.632 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227259&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:14:23.706 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169414013?api_key=51job&timestamp=1768227263 status=200 resp_size=10496
2026-01-12 22:14:23.906 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227263&companyId=1451330&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7271
2026-01-12 22:14:26.262 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168361598?api_key=51job&timestamp=1768227266 status=200 resp_size=5980
2026-01-12 22:14:26.467 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227266&companyId=2036019&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4474
2026-01-12 22:14:30.460 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169303036?api_key=51job&timestamp=1768227270 status=200 resp_size=8250
2026-01-12 22:14:30.617 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227270&companyId=323725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6484
2026-01-12 22:14:32.451 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169844681?api_key=51job&timestamp=1768227272 status=200 resp_size=6276
2026-01-12 22:14:32.712 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227272&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:14:35.372 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160005147?api_key=51job&timestamp=1768227275 status=200 resp_size=7515
2026-01-12 22:14:35.555 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227275&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
2026-01-12 22:14:43.939 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156927299?api_key=51job&timestamp=1768227283 status=200 resp_size=5621
2026-01-12 22:14:44.188 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227283&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13653
2026-01-12 22:14:49.074 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151665?api_key=51job&timestamp=1768227288 status=200 resp_size=6730
2026-01-12 22:14:49.245 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227289&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
2026-01-12 22:14:54.330 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169781093?api_key=51job&timestamp=1768227294 status=200 resp_size=8830
2026-01-12 22:14:54.527 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227294&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:15:02.129 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323197?api_key=51job&timestamp=1768227301 status=200 resp_size=6198
2026-01-12 22:15:02.414 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227302&companyId=9406941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7134
2026-01-12 22:15:08.404 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163971898?api_key=51job&timestamp=1768227307 status=200 resp_size=5683
2026-01-12 22:15:08.579 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227308&companyId=2112153&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10557
2026-01-12 22:15:13.942 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166642859?api_key=51job&timestamp=1768227313 status=200 resp_size=5146
2026-01-12 22:15:14.122 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227313&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
2026-01-12 22:15:22.446 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169917574?api_key=51job&timestamp=1768227321 status=200 resp_size=6563
2026-01-12 22:15:22.683 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227322&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:15:29.412 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169516936?api_key=51job&timestamp=1768227328 status=200 resp_size=8382
2026-01-12 22:15:29.649 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227329&companyId=8489874&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6388
2026-01-12 22:15:35.878 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169989833?api_key=51job&timestamp=1768227334 status=200 resp_size=7332
2026-01-12 22:15:36.097 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227335&companyId=5937718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10582
2026-01-12 22:15:46.507 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142100712?api_key=51job&timestamp=1768227345 status=200 resp_size=5924
2026-01-12 22:15:46.721 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227346&companyId=2509359&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6068
2026-01-12 22:15:46.722 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 7 页数据，包含详细信息的数据条数: 19
2026-01-12 22:15:46.785 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-12 22:15:46.786 | INFO     | __main__:crawl_multiple_pages:1031 - 第 7 页获取到 20 个职位 | 累计: 140 个
2026-01-12 22:15:51.389 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 4.60 秒后继续...
2026-01-12 22:15:51.389 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 8/26 页...
2026-01-12 22:15:51.389 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:15:51.415 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=8, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:15:51.937 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:15:53.054 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:15:55.173 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:15:55.173 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:15:55.589 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768227351 status=200 resp_size=131424
2026-01-12 22:15:55.589 | WARNING  | __main__:get_recommend_jobs:745 - 第 8 页发现 2 个重复职位（已跳过）
2026-01-12 22:15:55.589 | INFO     | __main__:get_recommend_jobs:747 - 第 8 页成功获取 20 个职位（去重后: 18） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:15:55.759 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169851617?api_key=51job&timestamp=1768227355 status=200 resp_size=6463
2026-01-12 22:15:55.900 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227355&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:16:01.933 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169948611?api_key=51job&timestamp=1768227361 status=200 resp_size=6442
2026-01-12 22:16:02.104 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227361&companyId=7226894&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6269
2026-01-12 22:16:06.362 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/67857747?api_key=51job&timestamp=1768227365 status=200 resp_size=6037
2026-01-12 22:16:06.523 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227366&companyId=2319747&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4408
2026-01-12 22:16:10.630 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166777021?api_key=51job&timestamp=1768227370 status=200 resp_size=5017
2026-01-12 22:16:11.145 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227370&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:16:14.811 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169948859?api_key=51job&timestamp=1768227374 status=200 resp_size=5946
2026-01-12 22:16:15.037 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227374&companyId=10111983&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4662
2026-01-12 22:16:22.810 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170167663?api_key=51job&timestamp=1768227381 status=200 resp_size=5119
2026-01-12 22:16:23.206 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227382&companyId=10007024&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3448
2026-01-12 22:16:31.046 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168502014?api_key=51job&timestamp=1768227390 status=200 resp_size=5713
2026-01-12 22:16:31.292 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227391&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
2026-01-12 22:16:37.672 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170150838?api_key=51job&timestamp=1768227396 status=200 resp_size=6519
2026-01-12 22:16:38.259 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227397&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:16:46.878 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163689976?api_key=51job&timestamp=1768227406 status=200 resp_size=7005
2026-01-12 22:16:47.089 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227406&companyId=2501599&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5304
2026-01-12 22:16:50.642 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170026619?api_key=51job&timestamp=1768227410 status=200 resp_size=5130
2026-01-12 22:16:50.954 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227410&companyId=10007024&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3448
2026-01-12 22:16:54.537 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165894104?api_key=51job&timestamp=1768227414 status=200 resp_size=7141
2026-01-12 22:16:54.906 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227414&companyId=5713012&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11344
2026-01-12 22:16:56.139 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170124203?api_key=51job&timestamp=1768227415 status=200 resp_size=5686
2026-01-12 22:16:56.381 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227416&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:17:02.285 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168927864?api_key=51job&timestamp=1768227421 status=200 resp_size=13124
2026-01-12 22:17:02.523 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227422&companyId=6108855&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9298
2026-01-12 22:17:07.542 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170110379?api_key=51job&timestamp=1768227427 status=200 resp_size=5761
2026-01-12 22:17:07.746 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227427&companyId=3094397&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6080
2026-01-12 22:17:13.966 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162634560?api_key=51job&timestamp=1768227433 status=200 resp_size=5800
2026-01-12 22:17:14.192 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227433&companyId=9437588&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5908
2026-01-12 22:17:21.111 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804679?api_key=51job&timestamp=1768227440 status=200 resp_size=6519
2026-01-12 22:17:21.432 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227441&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:17:24.653 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170029379?api_key=51job&timestamp=1768227444 status=200 resp_size=10587
2026-01-12 22:17:25.051 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227444&companyId=5844795&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5637
2026-01-12 22:17:27.184 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165412012?api_key=51job&timestamp=1768227446 status=200 resp_size=6777
2026-01-12 22:17:27.417 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227447&companyId=3733053&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11037
2026-01-12 22:17:27.418 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 8 页数据，包含详细信息的数据条数: 18
2026-01-12 22:17:27.470 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 18, 响应大小: 113 字节
2026-01-12 22:17:27.471 | INFO     | __main__:crawl_multiple_pages:1031 - 第 8 页获取到 20 个职位 | 累计: 160 个
2026-01-12 22:17:29.834 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 2.36 秒后继续...
2026-01-12 22:17:29.835 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 9/26 页...
2026-01-12 22:17:29.835 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:17:29.862 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=9, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:17:30.659 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:17:31.933 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:17:34.169 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:17:34.169 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:17:34.947 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768227449 status=200 resp_size=137462
2026-01-12 22:17:34.948 | WARNING  | __main__:get_recommend_jobs:745 - 第 9 页发现 1 个重复职位（已跳过）
2026-01-12 22:17:34.948 | INFO     | __main__:get_recommend_jobs:747 - 第 9 页成功获取 20 个职位（去重后: 19） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:17:35.306 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086850?api_key=51job&timestamp=1768227454 status=200 resp_size=8475
2026-01-12 22:17:35.690 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227455&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:17:39.012 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170231199?api_key=51job&timestamp=1768227458 status=200 resp_size=4036
2026-01-12 22:17:39.285 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227459&companyId=10150101&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2848
2026-01-12 22:17:47.888 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168834342?api_key=51job&timestamp=1768227467 status=200 resp_size=6159
2026-01-12 22:17:48.194 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227467&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:17:50.008 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170224996?api_key=51job&timestamp=1768227469 status=200 resp_size=4633
2026-01-12 22:17:50.241 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227470&companyId=10149556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2624
2026-01-12 22:17:59.302 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170037275?api_key=51job&timestamp=1768227478 status=200 resp_size=7971
2026-01-12 22:17:59.457 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227479&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7845
2026-01-12 22:18:01.777 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170110949?api_key=51job&timestamp=1768227481 status=200 resp_size=6196
2026-01-12 22:18:01.926 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227481&companyId=10137280&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2743
2026-01-12 22:18:05.734 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170100789?api_key=51job&timestamp=1768227485 status=200 resp_size=5700
2026-01-12 22:18:05.897 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227485&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:18:10.847 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166843455?api_key=51job&timestamp=1768227490 status=200 resp_size=9530
2026-01-12 22:18:11.021 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227490&companyId=2215274&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8872
2026-01-12 22:18:13.227 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170120883?api_key=51job&timestamp=1768227493 status=200 resp_size=6600
2026-01-12 22:18:13.384 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227493&companyId=2193352&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7910
2026-01-12 22:18:24.036 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166442404?api_key=51job&timestamp=1768227503 status=200 resp_size=7308
2026-01-12 22:18:24.244 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227504&companyId=2660390&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8331
2026-01-12 22:18:31.512 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169943708?api_key=51job&timestamp=1768227510 status=200 resp_size=5987
2026-01-12 22:18:31.731 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227511&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:18:41.385 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170142499?api_key=51job&timestamp=1768227520 status=200 resp_size=5260
2026-01-12 22:18:41.618 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227521&companyId=3863622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7117
2026-01-12 22:18:45.979 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169935463?api_key=51job&timestamp=1768227525 status=200 resp_size=5415
2026-01-12 22:18:46.260 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227525&companyId=10093538&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3901
2026-01-12 22:18:49.505 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169089271?api_key=51job&timestamp=1768227529 status=200 resp_size=5364
2026-01-12 22:18:49.670 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227529&companyId=7404484&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3315
2026-01-12 22:18:56.499 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169046179?api_key=51job&timestamp=1768227535 status=200 resp_size=5674
2026-01-12 22:18:56.739 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227536&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:19:01.221 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163506006?api_key=51job&timestamp=1768227540 status=200 resp_size=5450
2026-01-12 22:19:01.536 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227541&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
2026-01-12 22:19:12.383 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170136049?api_key=51job&timestamp=1768227551 status=200 resp_size=7217
2026-01-12 22:19:12.675 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227552&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7988
2026-01-12 22:19:22.853 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169936726?api_key=51job&timestamp=1768227562 status=200 resp_size=6459
2026-01-12 22:19:23.022 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227562&companyId=103026&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10750
2026-01-12 22:19:25.822 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169034126?api_key=51job&timestamp=1768227565 status=200 resp_size=8159
2026-01-12 22:19:27.068 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227565&companyId=7642544&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6020
2026-01-12 22:19:27.068 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 9 页数据，包含详细信息的数据条数: 19
2026-01-12 22:19:27.151 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-12 22:19:27.153 | INFO     | __main__:crawl_multiple_pages:1031 - 第 9 页获取到 20 个职位 | 累计: 180 个
2026-01-12 22:19:33.478 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 6.32 秒后继续...
2026-01-12 22:19:33.478 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 10/26 页...
2026-01-12 22:19:33.479 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:19:33.502 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=10, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:19:35.077 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:19:36.328 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:19:38.581 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:19:38.581 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:19:39.369 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768227573 status=200 resp_size=161897
2026-01-12 22:19:39.369 | WARNING  | __main__:get_recommend_jobs:745 - 第 10 页发现 2 个重复职位（已跳过）
2026-01-12 22:19:39.370 | INFO     | __main__:get_recommend_jobs:747 - 第 10 页成功获取 20 个职位（去重后: 18） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:19:39.616 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170052041?api_key=51job&timestamp=1768227579 status=200 resp_size=7503
2026-01-12 22:19:39.857 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227579&companyId=3967456&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11455
2026-01-12 22:19:42.370 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050278?api_key=51job&timestamp=1768227582 status=200 resp_size=9486
2026-01-12 22:19:42.624 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227582&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
2026-01-12 22:19:48.724 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170052240?api_key=51job&timestamp=1768227587 status=200 resp_size=5738
2026-01-12 22:19:49.027 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227588&companyId=721810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10659
2026-01-12 22:19:59.070 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170088704?api_key=51job&timestamp=1768227597 status=200 resp_size=7953
2026-01-12 22:19:59.324 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227599&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7988
2026-01-12 22:20:03.836 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167151944?api_key=51job&timestamp=1768227603 status=200 resp_size=6706
2026-01-12 22:20:04.059 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227603&companyId=2674552&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11008
2026-01-12 22:20:06.749 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168376540?api_key=51job&timestamp=1768227606 status=200 resp_size=5284
2026-01-12 22:20:06.972 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227606&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
2026-01-12 22:20:14.814 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158175505?api_key=51job&timestamp=1768227613 status=200 resp_size=7072
2026-01-12 22:20:15.037 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227614&companyId=8489874&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6388
2026-01-12 22:20:17.324 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169891207?api_key=51job&timestamp=1768227617 status=200 resp_size=6107
2026-01-12 22:20:17.530 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227617&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
2026-01-12 22:20:25.742 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/154053858?api_key=51job&timestamp=1768227624 status=200 resp_size=6883
2026-01-12 22:20:26.231 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227625&companyId=3396091&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8076
2026-01-12 22:20:32.393 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168631045?api_key=51job&timestamp=1768227631 status=200 resp_size=4916
2026-01-12 22:20:32.614 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227632&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
2026-01-12 22:20:38.878 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167779092?api_key=51job&timestamp=1768227637 status=200 resp_size=6086
2026-01-12 22:20:39.109 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227638&companyId=9160622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6567
2026-01-12 22:20:42.467 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169357292?api_key=51job&timestamp=1768227642 status=200 resp_size=6485
2026-01-12 22:20:42.682 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227642&companyId=2255809&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8112
2026-01-12 22:20:44.429 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170195716?api_key=51job&timestamp=1768227644 status=200 resp_size=8321
2026-01-12 22:20:44.640 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227644&companyId=6192298&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4023
2026-01-12 22:20:48.842 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169089492?api_key=51job&timestamp=1768227648 status=200 resp_size=6842
2026-01-12 22:20:49.125 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227648&companyId=9768323&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9447
2026-01-12 22:20:59.448 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140557776?api_key=51job&timestamp=1768227658 status=200 resp_size=5399
2026-01-12 22:20:59.891 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227659&companyId=2940827&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10918
2026-01-12 22:21:07.663 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170064049?api_key=51job&timestamp=1768227666 status=200 resp_size=5996
2026-01-12 22:21:08.039 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227667&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:21:12.399 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165654123?api_key=51job&timestamp=1768227672 status=200 resp_size=6528
2026-01-12 22:21:12.688 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227672&companyId=3287990&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4030
2026-01-12 22:21:16.955 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169128572?api_key=51job&timestamp=1768227676 status=200 resp_size=5337
2026-01-12 22:21:17.158 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227676&companyId=143102&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7176
2026-01-12 22:21:17.159 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 10 页数据，包含详细信息的数据条数: 18
2026-01-12 22:21:17.225 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 18, 响应大小: 113 字节
2026-01-12 22:21:17.226 | INFO     | __main__:crawl_multiple_pages:1031 - 第 10 页获取到 20 个职位 | 累计: 200 个
2026-01-12 22:21:22.110 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 4.88 秒后继续...
2026-01-12 22:21:22.110 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 11/26 页...
2026-01-12 22:21:22.111 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:21:22.134 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=11, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:21:23.298 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:21:24.438 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:21:26.558 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:21:26.558 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:21:27.035 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768227682 status=200 resp_size=155084
2026-01-12 22:21:27.035 | WARNING  | __main__:get_recommend_jobs:745 - 第 11 页发现 2 个重复职位（已跳过）
2026-01-12 22:21:27.035 | INFO     | __main__:get_recommend_jobs:747 - 第 11 页成功获取 20 个职位（去重后: 18） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:21:27.299 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169756645?api_key=51job&timestamp=1768227687 status=200 resp_size=6367
2026-01-12 22:21:27.473 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227687&companyId=5777317&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7920
2026-01-12 22:21:40.045 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170148331?api_key=51job&timestamp=1768227697 status=200 resp_size=6242
2026-01-12 22:21:40.331 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227700&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:21:42.828 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153925506?api_key=51job&timestamp=1768227702 status=200 resp_size=5824
2026-01-12 22:21:43.208 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227702&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13653
2026-01-12 22:21:54.977 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169357579?api_key=51job&timestamp=1768227712 status=200 resp_size=6222
2026-01-12 22:21:55.285 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227714&companyId=5566561&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7998
2026-01-12 22:22:01.502 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170115317?api_key=51job&timestamp=1768227720 status=200 resp_size=10976
2026-01-12 22:22:01.740 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227721&companyId=1451330&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7271
2026-01-12 22:22:10.641 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166253577?api_key=51job&timestamp=1768227729 status=200 resp_size=6225
2026-01-12 22:22:10.849 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227730&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:22:14.458 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163530512?api_key=51job&timestamp=1768227734 status=200 resp_size=5240
2026-01-12 22:22:14.655 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227734&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13653
2026-01-12 22:22:16.848 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170080054?api_key=51job&timestamp=1768227736 status=200 resp_size=6198
2026-01-12 22:22:17.096 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227736&companyId=10121432&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5374
2026-01-12 22:22:20.639 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168097451?api_key=51job&timestamp=1768227740 status=200 resp_size=5688
2026-01-12 22:22:20.890 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227740&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13653
2026-01-12 22:22:30.613 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168065249?api_key=51job&timestamp=1768227748 status=200 resp_size=5669
2026-01-12 22:22:30.930 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227750&companyId=9435350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5191
2026-01-12 22:22:32.531 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169830137?api_key=51job&timestamp=1768227752 status=200 resp_size=5893
2026-01-12 22:22:32.763 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227752&companyId=10109694&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5455
2026-01-12 22:22:37.067 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162576189?api_key=51job&timestamp=1768227756 status=200 resp_size=6070
2026-01-12 22:22:37.735 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227757&companyId=8399556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5849
2026-01-12 22:22:41.163 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170233170?api_key=51job&timestamp=1768227760 status=200 resp_size=6532
2026-01-12 22:22:41.603 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227761&companyId=10150186&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6054
2026-01-12 22:22:45.249 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170148568?api_key=51job&timestamp=1768227764 status=200 resp_size=9405
2026-01-12 22:22:45.608 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227765&companyId=5844795&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5637
2026-01-12 22:22:47.204 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169866545?api_key=51job&timestamp=1768227766 status=200 resp_size=6534
2026-01-12 22:22:47.549 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227767&companyId=9885576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2860
2026-01-12 22:22:49.664 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170134905?api_key=51job&timestamp=1768227768 status=200 resp_size=7369
2026-01-12 22:22:50.480 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227769&companyId=6144374&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7123
2026-01-12 22:22:55.486 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169783777?api_key=51job&timestamp=1768227774 status=200 resp_size=8723
2026-01-12 22:22:56.129 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227775&companyId=4659972&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6242
2026-01-12 22:23:02.008 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169966668?api_key=51job&timestamp=1768227780 status=200 resp_size=9642
2026-01-12 22:23:03.692 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227782&companyId=5844795&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5637
2026-01-12 22:23:03.692 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 11 页数据，包含详细信息的数据条数: 18
2026-01-12 22:23:03.767 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 18, 响应大小: 113 字节
2026-01-12 22:23:03.768 | INFO     | __main__:crawl_multiple_pages:1031 - 第 11 页获取到 20 个职位 | 累计: 220 个
2026-01-12 22:23:13.440 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 9.67 秒后继续...
2026-01-12 22:23:13.440 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 12/26 页...
2026-01-12 22:23:13.440 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:23:13.458 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=12, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:23:14.137 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:23:15.293 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:23:17.440 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:23:17.440 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:23:17.897 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768227793 status=200 resp_size=127505
2026-01-12 22:23:17.898 | INFO     | __main__:get_recommend_jobs:747 - 第 12 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:23:18.269 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169651289?api_key=51job&timestamp=1768227797 status=200 resp_size=5902
2026-01-12 22:23:18.537 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227798&companyId=13201&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10777
2026-01-12 22:23:28.061 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170026907?api_key=51job&timestamp=1768227804 status=200 resp_size=5719
2026-01-12 22:23:28.982 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227808&companyId=132788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7174
2026-01-12 22:23:33.591 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166552266?api_key=51job&timestamp=1768227812 status=200 resp_size=6216
2026-01-12 22:23:35.797 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227813&companyId=3287990&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4030
2026-01-12 22:23:46.391 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170100381?api_key=51job&timestamp=1768227825 status=200 resp_size=5810
2026-01-12 22:23:46.589 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227826&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:23:50.363 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146059327?api_key=51job&timestamp=1768227830 status=200 resp_size=6885
2026-01-12 22:23:50.588 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227830&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-12 22:23:58.690 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/124654690?api_key=51job&timestamp=1768227837 status=200 resp_size=6256
2026-01-12 22:23:58.984 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227838&companyId=5844795&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5637
2026-01-12 22:24:07.070 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169278821?api_key=51job&timestamp=1768227846 status=200 resp_size=6178
2026-01-12 22:24:07.224 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227847&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
2026-01-12 22:24:12.116 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168784707?api_key=51job&timestamp=1768227851 status=200 resp_size=6174
2026-01-12 22:24:12.273 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227852&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:24:21.004 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166654874?api_key=51job&timestamp=1768227860 status=200 resp_size=5396
2026-01-12 22:24:21.217 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227861&companyId=5783320&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7875
2026-01-12 22:24:28.681 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169002674?api_key=51job&timestamp=1768227867 status=200 resp_size=5177
2026-01-12 22:24:28.987 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227868&companyId=10013004&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4124
2026-01-12 22:24:31.512 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703937?api_key=51job&timestamp=1768227871 status=200 resp_size=4984
2026-01-12 22:24:31.727 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227871&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-12 22:24:38.687 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169120888?api_key=51job&timestamp=1768227878 status=200 resp_size=5398
2026-01-12 22:24:38.920 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227878&companyId=2352154&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7248
2026-01-12 22:24:47.965 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163371428?api_key=51job&timestamp=1768227887 status=200 resp_size=6568
2026-01-12 22:24:48.240 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227887&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-12 22:24:59.085 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/141481969?api_key=51job&timestamp=1768227898 status=200 resp_size=5736
2026-01-12 22:24:59.316 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227899&companyId=4248156&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10789
2026-01-12 22:25:01.993 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169135443?api_key=51job&timestamp=1768227901 status=200 resp_size=6933
2026-01-12 22:25:02.679 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227901&companyId=10008871&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7743
2026-01-12 22:25:06.191 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169664424?api_key=51job&timestamp=1768227905 status=200 resp_size=5294
2026-01-12 22:25:08.589 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227906&companyId=9867601&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3911
2026-01-12 22:25:15.068 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163366213?api_key=51job&timestamp=1768227914 status=200 resp_size=6296
2026-01-12 22:25:15.273 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227915&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-12 22:25:16.577 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169117047?api_key=51job&timestamp=1768227916 status=200 resp_size=6599
2026-01-12 22:25:16.772 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227916&companyId=3851409&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6742
2026-01-12 22:25:26.507 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152551025?api_key=51job&timestamp=1768227925 status=200 resp_size=6085
2026-01-12 22:25:26.756 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227926&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-12 22:25:33.002 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162401499?api_key=51job&timestamp=1768227931 status=200 resp_size=5014
2026-01-12 22:25:33.299 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227933&companyId=9348336&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4706
2026-01-12 22:25:33.300 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 12 页数据，包含详细信息的数据条数: 20
2026-01-12 22:25:33.360 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:25:33.360 | INFO     | __main__:crawl_multiple_pages:1031 - 第 12 页获取到 20 个职位 | 累计: 240 个
2026-01-12 22:25:37.220 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 3.86 秒后继续...
2026-01-12 22:25:37.220 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 13/26 页...
2026-01-12 22:25:37.220 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:25:37.239 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=13, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:25:38.312 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:25:39.540 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:25:41.793 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:25:41.794 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:25:42.291 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768227937 status=200 resp_size=115468
2026-01-12 22:25:42.292 | INFO     | __main__:get_recommend_jobs:747 - 第 13 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:25:42.531 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170146440?api_key=51job&timestamp=1768227942 status=200 resp_size=5352
2026-01-12 22:25:42.992 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227942&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
2026-01-12 22:25:52.749 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162880059?api_key=51job&timestamp=1768227951 status=200 resp_size=4913
2026-01-12 22:25:52.955 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227952&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
2026-01-12 22:26:00.768 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166020835?api_key=51job&timestamp=1768227960 status=200 resp_size=5283
2026-01-12 22:26:00.948 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227960&companyId=8456370&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3702
2026-01-12 22:26:10.241 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168691099?api_key=51job&timestamp=1768227968 status=200 resp_size=7224
2026-01-12 22:26:10.540 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227970&companyId=9984941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4680
2026-01-12 22:26:20.092 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166429097?api_key=51job&timestamp=1768227977 status=200 resp_size=5700
2026-01-12 22:26:20.466 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227980&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-12 22:26:25.518 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169379326?api_key=51job&timestamp=1768227984 status=200 resp_size=6948
2026-01-12 22:26:25.782 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227985&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
2026-01-12 22:26:35.374 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151993?api_key=51job&timestamp=1768227994 status=200 resp_size=5584
2026-01-12 22:26:35.713 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768227995&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-12 22:26:45.006 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170152283?api_key=51job&timestamp=1768228004 status=200 resp_size=7138
2026-01-12 22:26:45.181 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228005&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-12 22:26:53.755 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167900472?api_key=51job&timestamp=1768228012 status=200 resp_size=5280
2026-01-12 22:26:53.997 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228013&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
2026-01-12 22:27:04.164 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167778416?api_key=51job&timestamp=1768228023 status=200 resp_size=5070
2026-01-12 22:27:04.358 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228024&companyId=9926938&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4248
2026-01-12 22:27:11.572 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170122855?api_key=51job&timestamp=1768228030 status=200 resp_size=5389
2026-01-12 22:27:11.802 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228031&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-12 22:27:15.183 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703930?api_key=51job&timestamp=1768228034 status=200 resp_size=4877
2026-01-12 22:27:15.392 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228035&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-12 22:27:22.044 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163368886?api_key=51job&timestamp=1768228041 status=200 resp_size=6774
2026-01-12 22:27:22.355 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228042&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-12 22:27:36.908 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169346259?api_key=51job&timestamp=1768228049 status=200 resp_size=5312
2026-01-12 22:27:38.127 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228056&companyId=8456370&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3702
2026-01-12 22:27:48.978 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165587416?api_key=51job&timestamp=1768228067 status=200 resp_size=5772
2026-01-12 22:27:49.486 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228068&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 22:27:51.329 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156198851?api_key=51job&timestamp=1768228070 status=200 resp_size=5471
2026-01-12 22:27:51.556 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228071&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
2026-01-12 22:27:59.834 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169457024?api_key=51job&timestamp=1768228078 status=200 resp_size=5516
2026-01-12 22:28:00.136 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228079&companyId=8054908&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3024
2026-01-12 22:28:10.187 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/138806906?api_key=51job&timestamp=1768228089 status=200 resp_size=4791
2026-01-12 22:28:10.412 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228090&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
2026-01-12 22:28:15.188 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168135621?api_key=51job&timestamp=1768228094 status=200 resp_size=6762
2026-01-12 22:28:15.408 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228095&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-12 22:28:21.894 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169441521?api_key=51job&timestamp=1768228100 status=200 resp_size=5183
2026-01-12 22:28:22.153 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228101&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-12 22:28:22.153 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 13 页数据，包含详细信息的数据条数: 20
2026-01-12 22:28:22.198 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:28:22.199 | INFO     | __main__:crawl_multiple_pages:1031 - 第 13 页获取到 20 个职位 | 累计: 260 个
2026-01-12 22:28:30.409 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 8.21 秒后继续...
2026-01-12 22:28:30.410 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 14/26 页...
2026-01-12 22:28:30.410 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:28:30.433 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=14, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:28:31.267 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:28:32.438 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:28:34.645 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:28:34.645 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:28:35.327 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768228110 status=200 resp_size=156789
2026-01-12 22:28:35.328 | INFO     | __main__:get_recommend_jobs:747 - 第 14 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:28:35.669 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166951866?api_key=51job&timestamp=1768228115 status=200 resp_size=5280
2026-01-12 22:28:35.878 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228115&companyId=5140750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8232
2026-01-12 22:28:46.317 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166039131?api_key=51job&timestamp=1768228125 status=200 resp_size=5892
2026-01-12 22:28:46.548 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228126&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 22:28:53.900 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161197951?api_key=51job&timestamp=1768228133 status=200 resp_size=7110
2026-01-12 22:28:54.100 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228133&companyId=5922357&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7854
2026-01-12 22:28:56.762 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168746614?api_key=51job&timestamp=1768228136 status=200 resp_size=7708
2026-01-12 22:28:56.926 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228136&companyId=9223073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5242
2026-01-12 22:29:00.316 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169919865?api_key=51job&timestamp=1768228140 status=200 resp_size=6340
2026-01-12 22:29:00.480 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228140&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
2026-01-12 22:29:08.644 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169495651?api_key=51job&timestamp=1768228147 status=200 resp_size=4808
2026-01-12 22:29:09.052 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228148&companyId=10030663&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2474
2026-01-12 22:29:20.588 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169387554?api_key=51job&timestamp=1768228157 status=200 resp_size=9126
2026-01-12 22:29:21.138 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228160&companyId=9655981&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3362
2026-01-12 22:29:27.805 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170154072?api_key=51job&timestamp=1768228166 status=200 resp_size=5843
2026-01-12 22:29:27.985 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228167&companyId=10105052&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2583
2026-01-12 22:29:37.192 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153462006?api_key=51job&timestamp=1768228176 status=200 resp_size=5259
2026-01-12 22:29:37.415 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228177&companyId=2343589&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11277
2026-01-12 22:29:40.796 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152360694?api_key=51job&timestamp=1768228180 status=200 resp_size=5703
2026-01-12 22:29:40.989 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228180&companyId=8309189&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7408
2026-01-12 22:29:51.444 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/147062300?api_key=51job&timestamp=1768228190 status=200 resp_size=7067
2026-01-12 22:29:51.753 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228191&companyId=2859609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5470
2026-01-12 22:29:59.341 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/138538822?api_key=51job&timestamp=1768228198 status=200 resp_size=7613
2026-01-12 22:29:59.943 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228199&companyId=998618&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12022
2026-01-12 22:30:04.766 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140194322?api_key=51job&timestamp=1768228204 status=200 resp_size=7276
2026-01-12 22:30:05.078 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228204&companyId=6704793&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2972
2026-01-12 22:30:13.421 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170005961?api_key=51job&timestamp=1768228212 status=200 resp_size=6791
2026-01-12 22:30:13.631 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228213&companyId=6410180&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5579
2026-01-12 22:30:15.311 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170063024?api_key=51job&timestamp=1768228214 status=200 resp_size=6941
2026-01-12 22:30:15.608 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228215&companyId=110741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6422
2026-01-12 22:30:21.544 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/150106642?api_key=51job&timestamp=1768228220 status=200 resp_size=6557
2026-01-12 22:30:21.754 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228221&companyId=998618&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12022
2026-01-12 22:30:26.714 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142076420?api_key=51job&timestamp=1768228226 status=200 resp_size=6562
2026-01-12 22:30:26.894 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228226&companyId=1253610&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10021
2026-01-12 22:30:37.322 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156899271?api_key=51job&timestamp=1768228236 status=200 resp_size=6602
2026-01-12 22:30:37.516 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228237&companyId=7439393&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8050
2026-01-12 22:30:45.820 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170231674?api_key=51job&timestamp=1768228245 status=200 resp_size=5777
2026-01-12 22:30:45.992 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228245&companyId=6817482&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9941
2026-01-12 22:30:53.704 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162634483?api_key=51job&timestamp=1768228252 status=200 resp_size=6141
2026-01-12 22:30:53.928 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228253&companyId=9437588&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5908
2026-01-12 22:30:53.928 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 14 页数据，包含详细信息的数据条数: 20
2026-01-12 22:31:10.167 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:31:10.167 | INFO     | __main__:crawl_multiple_pages:1031 - 第 14 页获取到 20 个职位 | 累计: 280 个
2026-01-12 22:31:17.828 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 7.66 秒后继续...
2026-01-12 22:31:17.829 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 15/26 页...
2026-01-12 22:31:17.829 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:31:17.849 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=15, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:31:18.791 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:31:20.019 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:31:22.186 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:31:22.186 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:31:22.741 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768228277 status=200 resp_size=158428
2026-01-12 22:31:22.744 | WARNING  | __main__:get_recommend_jobs:745 - 第 15 页发现 1 个重复职位（已跳过）
2026-01-12 22:31:22.744 | INFO     | __main__:get_recommend_jobs:747 - 第 15 页成功获取 20 个职位（去重后: 19） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:31:22.954 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168950674?api_key=51job&timestamp=1768228282 status=200 resp_size=8778
2026-01-12 22:31:23.194 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228282&companyId=6108855&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9298
2026-01-12 22:31:32.543 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169998410?api_key=51job&timestamp=1768228291 status=200 resp_size=6727
2026-01-12 22:31:32.718 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228292&companyId=535193&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=14378
2026-01-12 22:31:42.393 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168947464?api_key=51job&timestamp=1768228301 status=200 resp_size=8678
2026-01-12 22:31:42.568 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228302&companyId=6104559&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8328
2026-01-12 22:31:50.536 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169817474?api_key=51job&timestamp=1768228309 status=200 resp_size=6345
2026-01-12 22:31:50.745 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228310&companyId=2545142&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10393
2026-01-12 22:31:53.809 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170121028?api_key=51job&timestamp=1768228313 status=200 resp_size=7930
2026-01-12 22:31:54.019 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228313&companyId=2215274&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8872
2026-01-12 22:32:01.557 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160067037?api_key=51job&timestamp=1768228320 status=200 resp_size=6531
2026-01-12 22:32:01.768 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228321&companyId=9177738&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6639
2026-01-12 22:32:03.875 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169821344?api_key=51job&timestamp=1768228323 status=200 resp_size=5922
2026-01-12 22:32:04.101 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228323&companyId=1250754&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10926
2026-01-12 22:32:14.673 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169125590?api_key=51job&timestamp=1768228333 status=200 resp_size=6743
2026-01-12 22:32:14.883 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228334&companyId=10008871&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7743
2026-01-12 22:32:25.249 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152935668?api_key=51job&timestamp=1768228342 status=200 resp_size=6723
2026-01-12 22:32:25.564 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228345&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-12 22:32:28.024 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170101075?api_key=51job&timestamp=1768228347 status=200 resp_size=6707
2026-01-12 22:32:28.324 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228348&companyId=10137987&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2793
2026-01-12 22:32:32.214 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168666885?api_key=51job&timestamp=1768228351 status=200 resp_size=5182
2026-01-12 22:32:32.520 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228352&companyId=9427564&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7748
2026-01-12 22:32:40.844 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169726149?api_key=51job&timestamp=1768228360 status=200 resp_size=7336
2026-01-12 22:32:41.021 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228360&companyId=103026&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10750
2026-01-12 22:32:46.756 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164447837?api_key=51job&timestamp=1768228366 status=200 resp_size=6464
2026-01-12 22:32:47.062 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228366&companyId=2011241&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7326
2026-01-12 22:32:54.125 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169628292?api_key=51job&timestamp=1768228372 status=200 resp_size=9292
2026-01-12 22:32:54.825 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228374&companyId=8488343&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6172
2026-01-12 22:32:56.250 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170128276?api_key=51job&timestamp=1768228375 status=200 resp_size=7408
2026-01-12 22:32:56.477 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228376&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
2026-01-12 22:32:59.010 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156246515?api_key=51job&timestamp=1768228378 status=200 resp_size=5204
2026-01-12 22:32:59.867 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228379&companyId=7393479&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4149
2026-01-12 22:33:10.408 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169233720?api_key=51job&timestamp=1768228389 status=200 resp_size=11982
2026-01-12 22:33:10.624 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228390&companyId=2911011&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7823
2026-01-12 22:33:14.490 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170087713?api_key=51job&timestamp=1768228394 status=200 resp_size=6382
2026-01-12 22:33:14.708 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228394&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
2026-01-12 22:33:23.808 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157642314?api_key=51job&timestamp=1768228403 status=200 resp_size=6287
2026-01-12 22:33:24.131 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228403&companyId=1644420&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7323
2026-01-12 22:33:24.131 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 15 页数据，包含详细信息的数据条数: 19
2026-01-12 22:33:24.217 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-12 22:33:24.218 | INFO     | __main__:crawl_multiple_pages:1031 - 第 15 页获取到 20 个职位 | 累计: 300 个
2026-01-12 22:33:31.748 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 7.53 秒后继续...
2026-01-12 22:33:31.748 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 16/26 页...
2026-01-12 22:33:31.748 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:33:31.768 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=16, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:33:32.736 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:33:33.952 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:33:36.213 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:33:36.213 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:33:36.780 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768228411 status=200 resp_size=132983
2026-01-12 22:33:36.781 | WARNING  | __main__:get_recommend_jobs:745 - 第 16 页发现 2 个重复职位（已跳过）
2026-01-12 22:33:36.781 | INFO     | __main__:get_recommend_jobs:747 - 第 16 页成功获取 20 个职位（去重后: 18） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:33:37.079 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170222457?api_key=51job&timestamp=1768228416 status=200 resp_size=5811
2026-01-12 22:33:37.381 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228417&companyId=2935467&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4653
2026-01-12 22:33:44.301 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157376245?api_key=51job&timestamp=1768228423 status=200 resp_size=5720
2026-01-12 22:33:44.509 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228424&companyId=2520800&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4957
2026-01-12 22:33:52.817 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169322384?api_key=51job&timestamp=1768228431 status=200 resp_size=4956
2026-01-12 22:33:53.109 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228432&companyId=9880556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3665
2026-01-12 22:33:59.436 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160775568?api_key=51job&timestamp=1768228438 status=200 resp_size=4906
2026-01-12 22:33:59.561 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228439&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
2026-01-12 22:34:06.801 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156198834?api_key=51job&timestamp=1768228445 status=200 resp_size=4844
2026-01-12 22:34:07.269 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228446&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-12 22:34:15.170 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160842300?api_key=51job&timestamp=1768228454 status=200 resp_size=6279
2026-01-12 22:34:15.738 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228455&companyId=6409434&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7029
2026-01-12 22:34:23.111 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169140721?api_key=51job&timestamp=1768228461 status=200 resp_size=5036
2026-01-12 22:34:23.419 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228463&companyId=9880556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3665
2026-01-12 22:34:28.235 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170103322?api_key=51job&timestamp=1768228467 status=200 resp_size=6072
2026-01-12 22:34:28.541 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228468&companyId=4247478&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9392
2026-01-12 22:34:35.092 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170056581?api_key=51job&timestamp=1768228474 status=200 resp_size=7334
2026-01-12 22:34:35.298 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228475&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
2026-01-12 22:34:39.293 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170068888?api_key=51job&timestamp=1768228479 status=200 resp_size=4996
2026-01-12 22:34:39.484 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228479&companyId=10133023&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-12 22:34:42.107 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170092618?api_key=51job&timestamp=1768228481 status=200 resp_size=6337
2026-01-12 22:34:42.362 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228482&companyId=8119509&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4974
2026-01-12 22:34:43.720 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165521981?api_key=51job&timestamp=1768228483 status=200 resp_size=5328
2026-01-12 22:34:43.889 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228483&companyId=9249115&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5712
2026-01-12 22:34:50.207 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166041972?api_key=51job&timestamp=1768228489 status=200 resp_size=5666
2026-01-12 22:34:50.453 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228490&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 22:34:59.218 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168616688?api_key=51job&timestamp=1768228498 status=200 resp_size=6738
2026-01-12 22:34:59.430 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228499&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-12 22:35:05.315 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169806989?api_key=51job&timestamp=1768228504 status=200 resp_size=6027
2026-01-12 22:35:05.505 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228505&companyId=7270223&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7318
2026-01-12 22:35:14.029 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170207190?api_key=51job&timestamp=1768228512 status=200 resp_size=5743
2026-01-12 22:35:14.235 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228514&companyId=10117882&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2667
2026-01-12 22:35:24.558 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703973?api_key=51job&timestamp=1768228523 status=200 resp_size=4786
2026-01-12 22:35:24.777 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228524&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-12 22:35:33.359 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164448807?api_key=51job&timestamp=1768228531 status=200 resp_size=6289
2026-01-12 22:35:33.636 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228533&companyId=4008171&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7281
2026-01-12 22:35:33.636 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 16 页数据，包含详细信息的数据条数: 18
2026-01-12 22:35:33.681 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 18, 响应大小: 113 字节
2026-01-12 22:35:33.683 | INFO     | __main__:crawl_multiple_pages:1031 - 第 16 页获取到 20 个职位 | 累计: 320 个
2026-01-12 22:35:38.588 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 4.90 秒后继续...
2026-01-12 22:35:38.588 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 17/26 页...
2026-01-12 22:35:38.588 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:35:38.608 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=17, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:35:39.402 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:35:40.628 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:35:42.812 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:35:42.812 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:35:43.342 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768228538 status=200 resp_size=135353
2026-01-12 22:35:43.342 | INFO     | __main__:get_recommend_jobs:747 - 第 17 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:35:43.598 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170014244?api_key=51job&timestamp=1768228543 status=200 resp_size=4917
2026-01-12 22:35:43.814 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228543&companyId=8807926&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5654
2026-01-12 22:35:46.677 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170188854?api_key=51job&timestamp=1768228546 status=200 resp_size=4845
2026-01-12 22:35:46.877 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228546&companyId=7206810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4861
2026-01-12 22:35:54.721 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170119049?api_key=51job&timestamp=1768228553 status=200 resp_size=8496
2026-01-12 22:35:54.900 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228554&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7988
2026-01-12 22:36:04.508 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/115092218?api_key=51job&timestamp=1768228562 status=200 resp_size=4945
2026-01-12 22:36:04.796 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228564&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-12 22:36:14.120 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165802289?api_key=51job&timestamp=1768228573 status=200 resp_size=5760
2026-01-12 22:36:14.302 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228574&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 22:36:25.182 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169255791?api_key=51job&timestamp=1768228584 status=200 resp_size=5933
2026-01-12 22:36:25.410 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228585&companyId=6145958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4709
2026-01-12 22:36:31.079 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169351366?api_key=51job&timestamp=1768228590 status=200 resp_size=7216
2026-01-12 22:36:31.240 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228591&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-12 22:36:37.142 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169892108?api_key=51job&timestamp=1768228596 status=200 resp_size=5148
2026-01-12 22:36:37.507 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228597&companyId=10115925&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2772
2026-01-12 22:36:43.300 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168796955?api_key=51job&timestamp=1768228602 status=200 resp_size=5991
2026-01-12 22:36:43.501 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228603&companyId=6133750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4397
2026-01-12 22:36:54.124 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170055934?api_key=51job&timestamp=1768228613 status=200 resp_size=7479
2026-01-12 22:36:54.360 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228614&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7988
2026-01-12 22:37:05.760 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169317263?api_key=51job&timestamp=1768228624 status=200 resp_size=5951
2026-01-12 22:37:05.982 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228625&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
2026-01-12 22:37:08.910 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/122347023?api_key=51job&timestamp=1768228628 status=200 resp_size=4719
2026-01-12 22:37:09.131 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228628&companyId=5872185&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3093
2026-01-12 22:37:14.915 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168803406?api_key=51job&timestamp=1768228634 status=200 resp_size=7719
2026-01-12 22:37:15.101 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228634&companyId=2055954&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10253
2026-01-12 22:37:24.514 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164925920?api_key=51job&timestamp=1768228643 status=200 resp_size=6381
2026-01-12 22:37:24.769 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228644&companyId=8115839&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5474
2026-01-12 22:37:26.490 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168738632?api_key=51job&timestamp=1768228646 status=200 resp_size=4654
2026-01-12 22:37:26.664 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228646&companyId=5270170&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10036
2026-01-12 22:37:36.810 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170182206?api_key=51job&timestamp=1768228656 status=200 resp_size=5328
2026-01-12 22:37:37.057 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228656&companyId=6170582&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9613
2026-01-12 22:37:39.105 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169962366?api_key=51job&timestamp=1768228658 status=200 resp_size=4709
2026-01-12 22:37:39.316 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228659&companyId=9107016&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3090
2026-01-12 22:37:43.408 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703967?api_key=51job&timestamp=1768228663 status=200 resp_size=4743
2026-01-12 22:37:43.610 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228663&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-12 22:37:50.681 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160775605?api_key=51job&timestamp=1768228669 status=200 resp_size=4761
2026-01-12 22:37:52.003 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228670&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
2026-01-12 22:38:01.736 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168215768?api_key=51job&timestamp=1768228681 status=200 resp_size=6331
2026-01-12 22:38:01.910 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228681&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
2026-01-12 22:38:01.910 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 17 页数据，包含详细信息的数据条数: 20
2026-01-12 22:38:01.940 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:38:01.941 | INFO     | __main__:crawl_multiple_pages:1031 - 第 17 页获取到 20 个职位 | 累计: 340 个
2026-01-12 22:38:05.247 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 3.31 秒后继续...
2026-01-12 22:38:05.247 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 18/26 页...
2026-01-12 22:38:05.248 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:38:05.268 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=18, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:38:06.028 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:38:07.264 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:38:09.397 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:38:09.398 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:38:09.874 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768228685 status=200 resp_size=129209
2026-01-12 22:38:09.874 | INFO     | __main__:get_recommend_jobs:747 - 第 18 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:38:10.131 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169403066?api_key=51job&timestamp=1768228689 status=200 resp_size=5352
2026-01-12 22:38:10.440 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228690&companyId=10035656&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2776
2026-01-12 22:38:18.835 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146619580?api_key=51job&timestamp=1768228697 status=200 resp_size=5262
2026-01-12 22:38:19.020 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228698&companyId=7465004&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4250
2026-01-12 22:38:20.325 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170198369?api_key=51job&timestamp=1768228700 status=200 resp_size=4534
2026-01-12 22:38:20.575 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228700&companyId=10088355&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2759
2026-01-12 22:38:29.858 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169994716?api_key=51job&timestamp=1768228709 status=200 resp_size=6046
2026-01-12 22:38:30.149 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228709&companyId=9409184&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6324
2026-01-12 22:38:36.728 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161915396?api_key=51job&timestamp=1768228715 status=200 resp_size=5889
2026-01-12 22:38:36.993 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228716&companyId=7556067&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7876
2026-01-12 22:38:38.505 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169982928?api_key=51job&timestamp=1768228718 status=200 resp_size=5300
2026-01-12 22:38:38.808 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228718&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
2026-01-12 22:38:47.405 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169209302?api_key=51job&timestamp=1768228726 status=200 resp_size=7337
2026-01-12 22:38:47.626 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228727&companyId=9223073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5242
2026-01-12 22:38:52.119 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167002102?api_key=51job&timestamp=1768228731 status=200 resp_size=7788
2026-01-12 22:38:52.340 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228732&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
2026-01-12 22:38:55.392 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169891057?api_key=51job&timestamp=1768228735 status=200 resp_size=6317
2026-01-12 22:38:55.599 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228735&companyId=2391505&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7935
2026-01-12 22:38:58.670 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169110406?api_key=51job&timestamp=1768228738 status=200 resp_size=5478
2026-01-12 22:38:58.875 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228738&companyId=2660745&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6602
2026-01-12 22:39:08.199 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166010636?api_key=51job&timestamp=1768228747 status=200 resp_size=5545
2026-01-12 22:39:08.605 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228748&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:39:18.037 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166502245?api_key=51job&timestamp=1768228757 status=200 resp_size=5252
2026-01-12 22:39:18.254 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228758&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:39:24.150 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137498?api_key=51job&timestamp=1768228763 status=200 resp_size=5883
2026-01-12 22:39:24.346 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228764&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7753
2026-01-12 22:39:35.049 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170071111?api_key=51job&timestamp=1768228771 status=200 resp_size=5496
2026-01-12 22:39:35.534 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228775&companyId=10079741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7440
2026-01-12 22:39:44.535 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168081251?api_key=51job&timestamp=1768228783 status=200 resp_size=5626
2026-01-12 22:39:44.852 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228784&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:39:53.061 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169842512?api_key=51job&timestamp=1768228792 status=200 resp_size=5496
2026-01-12 22:39:53.248 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228793&companyId=2749539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7753
2026-01-12 22:40:01.047 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162610802?api_key=51job&timestamp=1768228800 status=200 resp_size=6572
2026-01-12 22:40:01.235 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228801&companyId=3878684&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5741
2026-01-12 22:40:04.125 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165602449?api_key=51job&timestamp=1768228803 status=200 resp_size=5692
2026-01-12 22:40:04.319 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228804&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 22:40:09.195 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169158877?api_key=51job&timestamp=1768228809 status=200 resp_size=5476
2026-01-12 22:40:09.430 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228809&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:40:13.626 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703959?api_key=51job&timestamp=1768228813 status=200 resp_size=4874
2026-01-12 22:40:13.816 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228813&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-12 22:40:13.816 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 18 页数据，包含详细信息的数据条数: 20
2026-01-12 22:40:30.077 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:40:30.077 | INFO     | __main__:crawl_multiple_pages:1031 - 第 18 页获取到 20 个职位 | 累计: 360 个
2026-01-12 22:40:34.353 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 4.27 秒后继续...
2026-01-12 22:40:34.353 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 19/26 页...
2026-01-12 22:40:34.353 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:40:34.375 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=19, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:40:34.963 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:40:36.094 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:40:38.377 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:40:38.377 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:40:39.138 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768228834 status=200 resp_size=123428
2026-01-12 22:40:39.138 | INFO     | __main__:get_recommend_jobs:747 - 第 19 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:40:39.741 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169476017?api_key=51job&timestamp=1768228839 status=200 resp_size=5276
2026-01-12 22:40:40.354 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228839&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-12 22:40:43.888 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164607768?api_key=51job&timestamp=1768228843 status=200 resp_size=4507
2026-01-12 22:40:44.531 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228843&companyId=7357683&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4939
2026-01-12 22:40:48.994 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167326217?api_key=51job&timestamp=1768228848 status=200 resp_size=5446
2026-01-12 22:40:49.208 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228848&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:40:57.660 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170198398?api_key=51job&timestamp=1768228856 status=200 resp_size=4798
2026-01-12 22:40:57.964 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228857&companyId=9927028&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3647
2026-01-12 22:41:01.347 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169564003?api_key=51job&timestamp=1768228861 status=200 resp_size=5244
2026-01-12 22:41:01.570 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228861&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-12 22:41:11.893 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169887754?api_key=51job&timestamp=1768228870 status=200 resp_size=5511
2026-01-12 22:41:12.105 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228871&companyId=3944705&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7193
2026-01-12 22:41:13.422 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165944144?api_key=51job&timestamp=1768228873 status=200 resp_size=5241
2026-01-12 22:41:13.633 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228873&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:41:21.400 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167683950?api_key=51job&timestamp=1768228880 status=200 resp_size=6484
2026-01-12 22:41:21.556 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228881&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-12 22:41:26.097 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169962719?api_key=51job&timestamp=1768228885 status=200 resp_size=8628
2026-01-12 22:41:26.256 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228886&companyId=10123714&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2950
2026-01-12 22:41:33.807 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170096667?api_key=51job&timestamp=1768228893 status=200 resp_size=8470
2026-01-12 22:41:34.021 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228893&companyId=8558289&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7583
2026-01-12 22:41:38.106 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659851?api_key=51job&timestamp=1768228897 status=200 resp_size=6113
2026-01-12 22:41:38.265 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228898&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-12 22:41:47.084 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167597443?api_key=51job&timestamp=1768228906 status=200 resp_size=6555
2026-01-12 22:41:47.328 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228907&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-12 22:41:53.571 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170030865?api_key=51job&timestamp=1768228912 status=200 resp_size=6074
2026-01-12 22:41:53.731 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228913&companyId=10116929&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6111
2026-01-12 22:41:58.553 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168015383?api_key=51job&timestamp=1768228918 status=200 resp_size=5714
2026-01-12 22:41:58.697 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228918&companyId=9551244&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2696
2026-01-12 22:42:08.011 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659832?api_key=51job&timestamp=1768228926 status=200 resp_size=6131
2026-01-12 22:42:08.218 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228928&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-12 22:42:16.593 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166991140?api_key=51job&timestamp=1768228935 status=200 resp_size=5846
2026-01-12 22:42:16.825 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228936&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-12 22:42:20.091 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169796258?api_key=51job&timestamp=1768228938 status=200 resp_size=5515
2026-01-12 22:42:20.306 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228940&companyId=10060431&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3070
2026-01-12 22:42:28.114 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117492?api_key=51job&timestamp=1768228947 status=200 resp_size=5875
2026-01-12 22:42:28.276 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228948&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
2026-01-12 22:42:33.386 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166036465?api_key=51job&timestamp=1768228953 status=200 resp_size=6168
2026-01-12 22:42:33.537 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228953&companyId=9783603&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3141
2026-01-12 22:42:43.440 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167680919?api_key=51job&timestamp=1768228962 status=200 resp_size=5605
2026-01-12 22:42:43.745 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228963&companyId=9551244&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2696
2026-01-12 22:42:43.745 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 19 页数据，包含详细信息的数据条数: 20
2026-01-12 22:43:00.035 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:43:00.036 | INFO     | __main__:crawl_multiple_pages:1031 - 第 19 页获取到 20 个职位 | 累计: 380 个
2026-01-12 22:43:06.861 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 6.82 秒后继续...
2026-01-12 22:43:06.862 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 20/26 页...
2026-01-12 22:43:06.862 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:43:06.884 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=20, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:43:07.442 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:43:08.562 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:43:10.690 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:43:10.690 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:43:11.072 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768228986 status=200 resp_size=111806
2026-01-12 22:43:11.073 | INFO     | __main__:get_recommend_jobs:747 - 第 20 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:43:11.276 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170225792?api_key=51job&timestamp=1768228991 status=200 resp_size=5831
2026-01-12 22:43:11.431 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228991&companyId=10080902&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2578
2026-01-12 22:43:19.687 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169638988?api_key=51job&timestamp=1768228998 status=200 resp_size=5658
2026-01-12 22:43:19.971 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768228999&companyId=10092638&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2614
2026-01-12 22:43:27.741 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659766?api_key=51job&timestamp=1768229006 status=200 resp_size=6135
2026-01-12 22:43:27.952 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229007&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-12 22:43:31.773 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161853899?api_key=51job&timestamp=1768229011 status=200 resp_size=6256
2026-01-12 22:43:31.975 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229011&companyId=9332556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3829
2026-01-12 22:43:34.876 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169799789?api_key=51job&timestamp=1768229014 status=200 resp_size=5423
2026-01-12 22:43:35.078 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229014&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
2026-01-12 22:43:45.597 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168905144?api_key=51job&timestamp=1768229024 status=200 resp_size=5470
2026-01-12 22:43:45.892 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229025&companyId=8981254&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2938
2026-01-12 22:43:51.022 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659890?api_key=51job&timestamp=1768229030 status=200 resp_size=6130
2026-01-12 22:43:51.259 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229031&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-12 22:43:55.737 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117580?api_key=51job&timestamp=1768229035 status=200 resp_size=5876
2026-01-12 22:43:55.938 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229035&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
2026-01-12 22:43:59.522 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170130113?api_key=51job&timestamp=1768229039 status=200 resp_size=4643
2026-01-12 22:43:59.724 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229039&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
2026-01-12 22:44:03.111 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167757687?api_key=51job&timestamp=1768229042 status=200 resp_size=6103
2026-01-12 22:44:03.410 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229043&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-12 22:44:08.131 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169223393?api_key=51job&timestamp=1768229047 status=200 resp_size=6341
2026-01-12 22:44:08.331 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229048&companyId=9988138&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2629
2026-01-12 22:44:16.502 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170230212?api_key=51job&timestamp=1768229055 status=200 resp_size=6443
2026-01-12 22:44:16.725 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229056&companyId=10060431&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3070
2026-01-12 22:44:19.749 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169982916?api_key=51job&timestamp=1768229059 status=200 resp_size=5316
2026-01-12 22:44:19.911 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229059&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
2026-01-12 22:44:28.707 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167548048?api_key=51job&timestamp=1768229067 status=200 resp_size=5998
2026-01-12 22:44:29.013 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229068&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-12 22:44:38.220 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168364815?api_key=51job&timestamp=1768229077 status=200 resp_size=6502
2026-01-12 22:44:38.527 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229078&companyId=9915300&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2916
2026-01-12 22:44:45.395 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659823?api_key=51job&timestamp=1768229084 status=200 resp_size=6137
2026-01-12 22:44:45.607 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229085&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-12 22:44:48.577 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167140655?api_key=51job&timestamp=1768229088 status=200 resp_size=6214
2026-01-12 22:44:48.781 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229088&companyId=9868960&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4728
2026-01-12 22:44:57.584 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447472?api_key=51job&timestamp=1768229095 status=200 resp_size=6091
2026-01-12 22:44:57.888 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229097&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-12 22:45:07.418 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169381484?api_key=51job&timestamp=1768229106 status=200 resp_size=5556
2026-01-12 22:45:07.719 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229107&companyId=9987348&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3329
2026-01-12 22:45:10.387 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161484486?api_key=51job&timestamp=1768229110 status=200 resp_size=6839
2026-01-12 22:45:10.686 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229110&companyId=9337943&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5056
2026-01-12 22:45:10.686 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 20 页数据，包含详细信息的数据条数: 20
2026-01-12 22:45:10.771 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:45:10.771 | INFO     | __main__:crawl_multiple_pages:1031 - 第 20 页获取到 20 个职位 | 累计: 400 个
2026-01-12 22:45:17.212 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 6.44 秒后继续...
2026-01-12 22:45:17.212 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 21/26 页...
2026-01-12 22:45:17.212 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:45:17.250 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=21, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:45:17.931 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:45:19.116 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:45:21.276 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:45:21.276 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:45:21.721 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768229117 status=200 resp_size=110536
2026-01-12 22:45:21.722 | INFO     | __main__:get_recommend_jobs:747 - 第 21 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:45:21.974 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170035905?api_key=51job&timestamp=1768229121 status=200 resp_size=5831
2026-01-12 22:45:22.167 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229121&companyId=10130781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3987
2026-01-12 22:45:29.269 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168704503?api_key=51job&timestamp=1768229128 status=200 resp_size=7006
2026-01-12 22:45:29.524 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229129&companyId=8951858&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2638
2026-01-12 22:45:40.291 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170168776?api_key=51job&timestamp=1768229139 status=200 resp_size=5438
2026-01-12 22:45:40.574 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229140&companyId=9947218&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3078
2026-01-12 22:45:48.767 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166256202?api_key=51job&timestamp=1768229147 status=200 resp_size=6095
2026-01-12 22:45:49.008 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229148&companyId=9783603&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3141
2026-01-12 22:45:51.763 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167970981?api_key=51job&timestamp=1768229151 status=200 resp_size=5318
2026-01-12 22:45:52.012 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229151&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-12 22:45:53.799 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169563935?api_key=51job&timestamp=1768229153 status=200 resp_size=5562
2026-01-12 22:45:54.109 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229153&companyId=10035110&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2686
2026-01-12 22:46:04.543 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170168498?api_key=51job&timestamp=1768229163 status=200 resp_size=6087
2026-01-12 22:46:04.747 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229164&companyId=10056177&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3008
2026-01-12 22:46:14.985 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161407023?api_key=51job&timestamp=1768229172 status=200 resp_size=6040
2026-01-12 22:46:15.346 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229174&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-12 22:46:22.583 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169257199?api_key=51job&timestamp=1768229181 status=200 resp_size=6221
2026-01-12 22:46:22.781 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229182&companyId=10028121&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2934
2026-01-12 22:46:26.088 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169209761?api_key=51job&timestamp=1768229185 status=200 resp_size=6466
2026-01-12 22:46:26.266 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229186&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-12 22:46:28.515 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170188855?api_key=51job&timestamp=1768229188 status=200 resp_size=5408
2026-01-12 22:46:28.709 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229188&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
2026-01-12 22:46:39.339 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659804?api_key=51job&timestamp=1768229198 status=200 resp_size=6137
2026-01-12 22:46:39.497 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229199&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-12 22:46:43.281 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170137977?api_key=51job&timestamp=1768229203 status=200 resp_size=5663
2026-01-12 22:46:43.564 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229203&companyId=10140724&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2560
2026-01-12 22:46:51.500 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161452712?api_key=51job&timestamp=1768229210 status=200 resp_size=6320
2026-01-12 22:46:51.756 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229211&companyId=9332556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3829
2026-01-12 22:46:59.232 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161325022?api_key=51job&timestamp=1768229218 status=200 resp_size=6475
2026-01-12 22:46:59.477 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229219&companyId=7076144&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6126
2026-01-12 22:47:03.015 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659882?api_key=51job&timestamp=1768229222 status=200 resp_size=6131
2026-01-12 22:47:03.232 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229223&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-12 22:47:05.468 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170081297?api_key=51job&timestamp=1768229225 status=200 resp_size=6348
2026-01-12 22:47:05.685 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229225&companyId=10134359&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2933
2026-01-12 22:47:07.061 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170188120?api_key=51job&timestamp=1768229226 status=200 resp_size=5427
2026-01-12 22:47:07.261 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229227&companyId=10143308&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2777
2026-01-12 22:47:09.783 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169766298?api_key=51job&timestamp=1768229229 status=200 resp_size=5329
2026-01-12 22:47:09.983 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229229&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-12 22:47:14.287 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659794?api_key=51job&timestamp=1768229234 status=200 resp_size=6137
2026-01-12 22:47:14.592 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229234&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-12 22:47:14.592 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 21 页数据，包含详细信息的数据条数: 20
2026-01-12 22:47:14.630 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:47:14.631 | INFO     | __main__:crawl_multiple_pages:1031 - 第 21 页获取到 20 个职位 | 累计: 420 个
2026-01-12 22:47:24.157 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 9.53 秒后继续...
2026-01-12 22:47:24.157 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 22/26 页...
2026-01-12 22:47:24.158 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:47:24.181 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=22, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:47:24.896 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:47:26.096 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:47:28.261 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:47:28.262 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:47:28.726 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768229244 status=200 resp_size=122771
2026-01-12 22:47:28.726 | INFO     | __main__:get_recommend_jobs:747 - 第 22 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:47:28.985 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169913105?api_key=51job&timestamp=1768229248 status=200 resp_size=6858
2026-01-12 22:47:29.193 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229248&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-12 22:47:36.197 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170194486?api_key=51job&timestamp=1768229255 status=200 resp_size=6006
2026-01-12 22:47:36.390 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229256&companyId=10049670&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4409
2026-01-12 22:47:41.002 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170222163?api_key=51job&timestamp=1768229260 status=200 resp_size=6229
2026-01-12 22:47:41.206 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229261&companyId=10134628&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2816
2026-01-12 22:47:47.652 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659859?api_key=51job&timestamp=1768229266 status=200 resp_size=6131
2026-01-12 22:47:48.203 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229267&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-12 22:47:55.143 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169235121?api_key=51job&timestamp=1768229273 status=200 resp_size=5692
2026-01-12 22:47:55.342 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229275&companyId=10054286&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2900
2026-01-12 22:48:02.313 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166965686?api_key=51job&timestamp=1768229280 status=200 resp_size=6164
2026-01-12 22:48:02.623 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229282&companyId=9177616&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2800
2026-01-12 22:48:12.443 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168244215?api_key=51job&timestamp=1768229291 status=200 resp_size=6114
2026-01-12 22:48:12.579 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229292&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-12 22:48:14.959 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659869?api_key=51job&timestamp=1768229294 status=200 resp_size=6133
2026-01-12 22:48:15.130 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229294&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-12 22:48:24.881 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170043073?api_key=51job&timestamp=1768229303 status=200 resp_size=6249
2026-01-12 22:48:25.144 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229304&companyId=10128381&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4062
2026-01-12 22:48:33.609 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086883?api_key=51job&timestamp=1768229312 status=200 resp_size=6045
2026-01-12 22:48:33.766 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229313&companyId=10130781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3987
2026-01-12 22:48:37.681 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167556977?api_key=51job&timestamp=1768229317 status=200 resp_size=5697
2026-01-12 22:48:37.831 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229317&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-12 22:48:45.922 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161659846?api_key=51job&timestamp=1768229325 status=200 resp_size=6162
2026-01-12 22:48:46.238 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229325&companyId=9330837&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5355
2026-01-12 22:48:54.217 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170117659?api_key=51job&timestamp=1768229333 status=200 resp_size=5879
2026-01-12 22:48:54.431 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229334&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
2026-01-12 22:49:04.297 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169285354?api_key=51job&timestamp=1768229343 status=200 resp_size=5350
2026-01-12 22:49:04.525 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229344&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:49:10.882 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167335011?api_key=51job&timestamp=1768229350 status=200 resp_size=6118
2026-01-12 22:49:11.081 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229350&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-12 22:49:19.006 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169589901?api_key=51job&timestamp=1768229358 status=200 resp_size=5192
2026-01-12 22:49:19.152 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229359&companyId=6109103&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6432
2026-01-12 22:49:28.612 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169671666?api_key=51job&timestamp=1768229367 status=200 resp_size=5859
2026-01-12 22:49:28.871 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229368&companyId=10090820&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2652
2026-01-12 22:49:37.595 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170019826?api_key=51job&timestamp=1768229376 status=200 resp_size=5600
2026-01-12 22:49:37.875 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229377&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:49:39.331 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169695811?api_key=51job&timestamp=1768229379 status=200 resp_size=5106
2026-01-12 22:49:39.550 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229379&companyId=2753261&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5037
2026-01-12 22:49:42.684 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167880986?api_key=51job&timestamp=1768229382 status=200 resp_size=6429
2026-01-12 22:49:42.967 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229382&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-12 22:49:42.967 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 22 页数据，包含详细信息的数据条数: 20
2026-01-12 22:49:43.062 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:49:43.062 | INFO     | __main__:crawl_multiple_pages:1031 - 第 22 页获取到 20 个职位 | 累计: 440 个
2026-01-12 22:49:52.150 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 9.09 秒后继续...
2026-01-12 22:49:52.150 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 23/26 页...
2026-01-12 22:49:52.150 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:49:52.177 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=23, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:49:52.859 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:49:54.026 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:49:56.282 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:49:56.283 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:49:57.555 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768229392 status=200 resp_size=136713
2026-01-12 22:49:57.555 | INFO     | __main__:get_recommend_jobs:747 - 第 23 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:49:57.802 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168451756?api_key=51job&timestamp=1768229397 status=200 resp_size=6053
2026-01-12 22:49:58.173 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229397&companyId=9473616&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2972
2026-01-12 22:50:03.360 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167611793?api_key=51job&timestamp=1768229403 status=200 resp_size=5403
2026-01-12 22:50:03.557 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229403&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:50:04.982 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169656442?api_key=51job&timestamp=1768229404 status=200 resp_size=4972
2026-01-12 22:50:05.202 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229404&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-12 22:50:14.823 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167378338?api_key=51job&timestamp=1768229413 status=200 resp_size=6993
2026-01-12 22:50:15.185 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229414&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-12 22:50:19.220 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168814114?api_key=51job&timestamp=1768229418 status=200 resp_size=7151
2026-01-12 22:50:19.533 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229419&companyId=9509175&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6253
2026-01-12 22:50:21.596 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169859255?api_key=51job&timestamp=1768229421 status=200 resp_size=5439
2026-01-12 22:50:21.883 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229421&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:50:23.428 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165495518?api_key=51job&timestamp=1768229423 status=200 resp_size=4861
2026-01-12 22:50:23.588 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229423&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-12 22:50:27.512 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167880850?api_key=51job&timestamp=1768229427 status=200 resp_size=7109
2026-01-12 22:50:27.774 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229427&companyId=9882398&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4480
2026-01-12 22:50:34.778 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170083146?api_key=51job&timestamp=1768229433 status=200 resp_size=6535
2026-01-12 22:50:34.996 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229434&companyId=10029006&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3054
2026-01-12 22:50:43.280 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163532123?api_key=51job&timestamp=1768229442 status=200 resp_size=6351
2026-01-12 22:50:43.487 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229443&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:50:50.321 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168494145?api_key=51job&timestamp=1768229449 status=200 resp_size=5747
2026-01-12 22:50:50.604 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229450&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-12 22:50:51.986 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170214296?api_key=51job&timestamp=1768229451 status=200 resp_size=6278
2026-01-12 22:50:52.249 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229451&companyId=10134486&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4833
2026-01-12 22:51:02.880 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170215196?api_key=51job&timestamp=1768229461 status=200 resp_size=5893
2026-01-12 22:51:03.136 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229462&companyId=3238676&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6838
2026-01-12 22:51:13.103 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169158029?api_key=51job&timestamp=1768229472 status=200 resp_size=6548
2026-01-12 22:51:13.395 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229473&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:51:15.870 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168969461?api_key=51job&timestamp=1768229475 status=200 resp_size=4871
2026-01-12 22:51:16.037 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229475&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-12 22:51:17.757 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163531112?api_key=51job&timestamp=1768229477 status=200 resp_size=5159
2026-01-12 22:51:17.934 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229477&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:51:21.118 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165314540?api_key=51job&timestamp=1768229480 status=200 resp_size=5080
2026-01-12 22:51:21.328 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229481&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-12 22:51:27.799 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157830322?api_key=51job&timestamp=1768229487 status=200 resp_size=6104
2026-01-12 22:51:27.990 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229487&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:51:36.303 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169677822?api_key=51job&timestamp=1768229495 status=200 resp_size=5130
2026-01-12 22:51:36.507 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229496&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-12 22:51:39.704 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166962183?api_key=51job&timestamp=1768229499 status=200 resp_size=5503
2026-01-12 22:51:39.964 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229499&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:51:39.964 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 23 页数据，包含详细信息的数据条数: 20
2026-01-12 22:51:40.035 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:51:40.035 | INFO     | __main__:crawl_multiple_pages:1031 - 第 23 页获取到 20 个职位 | 累计: 460 个
2026-01-12 22:51:48.366 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 8.33 秒后继续...
2026-01-12 22:51:48.366 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 24/26 页...
2026-01-12 22:51:48.367 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:51:48.387 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=24, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:51:49.332 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:51:50.637 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:51:52.806 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:51:52.807 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:51:53.329 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768229508 status=200 resp_size=129904
2026-01-12 22:51:53.330 | INFO     | __main__:get_recommend_jobs:747 - 第 24 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:51:53.735 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169657394?api_key=51job&timestamp=1768229513 status=200 resp_size=5106
2026-01-12 22:51:54.039 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229513&companyId=3722180&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7231
2026-01-12 22:52:03.975 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169454398?api_key=51job&timestamp=1768229523 status=200 resp_size=5351
2026-01-12 22:52:04.168 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229523&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:52:06.077 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169098312?api_key=51job&timestamp=1768229525 status=200 resp_size=4873
2026-01-12 22:52:06.263 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229526&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-12 22:52:08.379 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167001838?api_key=51job&timestamp=1768229528 status=200 resp_size=7710
2026-01-12 22:52:08.572 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229528&companyId=5407913&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3428
2026-01-12 22:52:18.099 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170228069?api_key=51job&timestamp=1768229537 status=200 resp_size=5016
2026-01-12 22:52:18.337 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229538&companyId=10149719&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2623
2026-01-12 22:52:23.420 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158383065?api_key=51job&timestamp=1768229543 status=200 resp_size=5237
2026-01-12 22:52:23.728 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229543&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:52:33.874 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165599554?api_key=51job&timestamp=1768229553 status=200 resp_size=5054
2026-01-12 22:52:34.070 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229553&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-12 22:52:41.536 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168269535?api_key=51job&timestamp=1768229560 status=200 resp_size=7321
2026-01-12 22:52:41.706 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229561&companyId=1249&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11118
2026-01-12 22:52:48.813 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170235125?api_key=51job&timestamp=1768229567 status=200 resp_size=4437
2026-01-12 22:52:49.233 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229568&companyId=10150403&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2584
2026-01-12 22:52:51.298 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163531354?api_key=51job&timestamp=1768229570 status=200 resp_size=5203
2026-01-12 22:52:51.590 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229571&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:52:58.030 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167500480?api_key=51job&timestamp=1768229577 status=200 resp_size=5212
2026-01-12 22:52:58.236 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229578&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-12 22:53:03.562 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170187764?api_key=51job&timestamp=1768229583 status=200 resp_size=6980
2026-01-12 22:53:03.980 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229583&companyId=9988698&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5227
2026-01-12 22:53:05.748 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169238188?api_key=51job&timestamp=1768229585 status=200 resp_size=6819
2026-01-12 22:53:05.946 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229585&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8122
2026-01-12 22:53:12.683 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156101106?api_key=51job&timestamp=1768229591 status=200 resp_size=4883
2026-01-12 22:53:12.891 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229592&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:53:17.394 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169282370?api_key=51job&timestamp=1768229597 status=200 resp_size=5582
2026-01-12 22:53:17.694 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229597&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-12 22:53:27.118 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169573989?api_key=51job&timestamp=1768229606 status=200 resp_size=6900
2026-01-12 22:53:27.320 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229607&companyId=9988698&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5227
2026-01-12 22:53:31.860 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169445411?api_key=51job&timestamp=1768229611 status=200 resp_size=4989
2026-01-12 22:53:32.060 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229611&companyId=5711980&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4029
2026-01-12 22:53:36.511 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169453384?api_key=51job&timestamp=1768229616 status=200 resp_size=5218
2026-01-12 22:53:36.710 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229616&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:53:40.069 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169322393?api_key=51job&timestamp=1768229619 status=200 resp_size=5166
2026-01-12 22:53:40.256 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229620&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-12 22:53:46.495 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169238197?api_key=51job&timestamp=1768229625 status=200 resp_size=6533
2026-01-12 22:53:46.679 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229626&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8122
2026-01-12 22:53:46.679 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 24 页数据，包含详细信息的数据条数: 20
2026-01-12 22:53:46.749 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:53:46.749 | INFO     | __main__:crawl_multiple_pages:1031 - 第 24 页获取到 20 个职位 | 累计: 480 个
2026-01-12 22:53:48.822 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 2.06 秒后继续...
2026-01-12 22:53:48.822 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 25/26 页...
2026-01-12 22:53:48.822 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:53:48.863 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=25, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:53:49.550 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:53:50.719 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:53:52.887 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:53:52.887 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:53:53.433 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768229628 status=200 resp_size=137112
2026-01-12 22:53:53.433 | INFO     | __main__:get_recommend_jobs:747 - 第 25 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:53:53.642 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169264341?api_key=51job&timestamp=1768229633 status=200 resp_size=5146
2026-01-12 22:53:53.835 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229633&companyId=5711980&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4029
2026-01-12 22:54:02.758 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169083638?api_key=51job&timestamp=1768229641 status=200 resp_size=5063
2026-01-12 22:54:02.985 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229642&companyId=2588600&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6524
2026-01-12 22:54:13.169 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169584108?api_key=51job&timestamp=1768229652 status=200 resp_size=5313
2026-01-12 22:54:13.352 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229653&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-12 22:54:22.388 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169238151?api_key=51job&timestamp=1768229661 status=200 resp_size=6455
2026-01-12 22:54:22.656 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229662&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8122
2026-01-12 22:54:24.807 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169984603?api_key=51job&timestamp=1768229664 status=200 resp_size=8614
2026-01-12 22:54:25.043 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229664&companyId=1318822&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=14621
2026-01-12 22:54:31.821 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169063816?api_key=51job&timestamp=1768229670 status=200 resp_size=5160
2026-01-12 22:54:32.069 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229671&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-12 22:54:33.486 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157363847?api_key=51job&timestamp=1768229673 status=200 resp_size=6228
2026-01-12 22:54:33.736 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229673&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-12 22:54:38.889 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157640092?api_key=51job&timestamp=1768229678 status=200 resp_size=4992
2026-01-12 22:54:39.139 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229678&companyId=3565909&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7934
2026-01-12 22:54:43.626 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168579646?api_key=51job&timestamp=1768229683 status=200 resp_size=5107
2026-01-12 22:54:43.901 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229683&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-12 22:54:47.326 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152329954?api_key=51job&timestamp=1768229687 status=200 resp_size=6652
2026-01-12 22:54:47.588 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229687&companyId=3035619&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3986
2026-01-12 22:54:55.427 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169532181?api_key=51job&timestamp=1768229694 status=200 resp_size=7080
2026-01-12 22:54:55.640 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229695&companyId=9967606&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7537
2026-01-12 22:55:05.274 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170203992?api_key=51job&timestamp=1768229704 status=200 resp_size=5002
2026-01-12 22:55:05.454 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229705&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-12 22:55:13.039 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168250176?api_key=51job&timestamp=1768229712 status=200 resp_size=4745
2026-01-12 22:55:13.208 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229713&companyId=2695344&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11853
2026-01-12 22:55:22.025 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166351162?api_key=51job&timestamp=1768229721 status=200 resp_size=10685
2026-01-12 22:55:22.254 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229722&companyId=5922357&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7854
2026-01-12 22:55:31.841 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/66775639?api_key=51job&timestamp=1768229730 status=200 resp_size=6536
2026-01-12 22:55:32.080 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229731&companyId=3035619&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3986
2026-01-12 22:55:41.587 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169294600?api_key=51job&timestamp=1768229740 status=200 resp_size=4889
2026-01-12 22:55:41.869 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229741&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-12 22:55:52.174 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152599245?api_key=51job&timestamp=1768229751 status=200 resp_size=5460
2026-01-12 22:55:52.373 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229752&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-12 22:55:55.295 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162522300?api_key=51job&timestamp=1768229755 status=200 resp_size=5069
2026-01-12 22:55:55.573 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229755&companyId=8358035&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7225
2026-01-12 22:56:01.340 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170196220?api_key=51job&timestamp=1768229760 status=200 resp_size=4315
2026-01-12 22:56:01.513 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229761&companyId=10146288&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3045
2026-01-12 22:56:04.554 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169624798?api_key=51job&timestamp=1768229764 status=200 resp_size=4912
2026-01-12 22:56:04.723 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229764&companyId=5071895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4991
2026-01-12 22:56:04.723 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 25 页数据，包含详细信息的数据条数: 20
2026-01-12 22:56:12.952 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:56:12.957 | INFO     | __main__:crawl_multiple_pages:1031 - 第 25 页获取到 20 个职位 | 累计: 500 个
2026-01-12 22:56:16.407 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 3.45 秒后继续...
2026-01-12 22:56:16.407 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 26/26 页...
2026-01-12 22:56:16.409 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:56:16.485 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=26, 页大小=20, 地区=32100, 工作类型=2956
2026-01-12 22:56:17.168 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:56:18.338 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:56:20.506 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:56:20.506 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:56:20.902 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768229776 status=200 resp_size=9174
2026-01-12 22:56:20.902 | INFO     | __main__:get_recommend_jobs:747 - 第 26 页成功获取 1 个职位（去重后: 1） | API返回totalCount: 501 (原始值: 501) | 地区: 河源(32100) | 职能: 高级硬件工程师(2956)
2026-01-12 22:56:21.101 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160337489?api_key=51job&timestamp=1768229780 status=200 resp_size=5936
2026-01-12 22:56:21.306 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229781&companyId=2254196&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9308
2026-01-12 22:56:21.306 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 26 页数据，包含详细信息的数据条数: 1
2026-01-12 22:56:21.346 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 1, 响应大小: 112 字节
2026-01-12 22:56:21.346 | INFO     | __main__:crawl_multiple_pages:1031 - 第 26 页获取到 1 个职位 | 累计: 501 个
2026-01-12 22:56:21.346 | INFO     | __main__:crawl_multiple_pages:1039 - 已获取所有数据 (501/501)，提前结束爬取
2026-01-12 22:56:21.347 | INFO     | __main__:crawl_multiple_pages:1056 - 
================================================================================
2026-01-12 22:56:21.347 | INFO     | __main__:crawl_multiple_pages:1057 - 爬取统计信息:
2026-01-12 22:56:21.347 | INFO     | __main__:crawl_multiple_pages:1058 -   总抓取数量: 501 条
2026-01-12 22:56:21.347 | INFO     | __main__:crawl_multiple_pages:1059 -   去重后数量: 490 条
2026-01-12 22:56:21.348 | INFO     | __main__:crawl_multiple_pages:1060 -   重复数量: 11 条
2026-01-12 22:56:21.348 | INFO     | __main__:crawl_multiple_pages:1061 -   API返回totalCount: 501 条
2026-01-12 22:56:21.348 | INFO     | __main__:crawl_multiple_pages:1062 -   实际爬取页数: 26 页
2026-01-12 22:56:21.348 | INFO     | __main__:crawl_multiple_pages:1063 -   地区: 河源(32100)
2026-01-12 22:56:21.348 | INFO     | __main__:crawl_multiple_pages:1064 -   职能: 高级硬件工程师(2956)
2026-01-12 22:56:21.348 | INFO     | __main__:crawl_multiple_pages:1067 -   覆盖率: 97.80% (490/501)
2026-01-12 22:56:21.348 | WARNING  | __main__:crawl_multiple_pages:1069 -  注意: 实际抓取数量(490) < API返回总数(501)，可能存在分页问题或数据过滤
2026-01-12 22:56:21.348 | INFO     | __main__:crawl_multiple_pages:1072 - ================================================================================

2026-01-12 22:56:21.348 | INFO     | __main__:save_crawl_stats:131 - 统计信息已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_stats.log
2026-01-12 22:56:21.348 | INFO     | __main__:crawl_multiple_pages:1086 - 职位记录已保存到: D:\codeing\otherMoney\JobData\jobs_spider\qcwy\crawl_jobs_records.log (共 490 条记录)
2026-01-12 22:56:21.348 | INFO     | __main__:crawl_recommend_jobs_main:1216 - 推荐职位爬取完成！共找到 490 个职位
2026-01-12 22:56:21.350 | INFO     | __main__:close:1137 - httpx客户端已关闭
2026-01-12 22:56:25.202 | INFO     | __main__:crawl_recommend_jobs_main:1170 - 已配置代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:56:25.220 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:56:25.296 | INFO     | __main__:crawl_recommend_jobs_main:1198 - 随机选择城市: 义乌 (81400)
2026-01-12 22:56:25.296 | INFO     | __main__:crawl_recommend_jobs_main:1202 - 随机选择工作类型: 夹具工程师 (0565)
2026-01-12 22:56:25.296 | INFO     | __main__:crawl_recommend_jobs_main:1204 - 开始爬取推荐职位，最多 50 页
2026-01-12 22:56:25.296 | INFO     | __main__:crawl_multiple_pages:1000 - ================================================================================
2026-01-12 22:56:25.301 | INFO     | __main__:crawl_multiple_pages:1001 - 开始爬取推荐职位 | 最大页数: 50 | 每页大小: 20 | 地区: 义乌(81400) | 职能: 夹具工程师(0565)
2026-01-12 22:56:25.301 | INFO     | __main__:crawl_multiple_pages:1002 - ================================================================================
2026-01-12 22:56:25.301 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 1/50 页...
2026-01-12 22:56:25.301 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:56:25.347 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=1, 页大小=20, 地区=81400, 工作类型=0565
2026-01-12 22:56:25.994 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:56:27.140 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:56:29.279 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:56:29.279 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:56:29.812 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768229785 status=200 resp_size=120630
2026-01-12 22:56:29.817 | INFO     | __main__:get_recommend_jobs:747 - 第 1 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 义乌(81400) | 职能: 夹具工程师(0565)
2026-01-12 22:56:30.121 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167971991?api_key=51job&timestamp=1768229789 status=200 resp_size=5965
2026-01-12 22:56:30.296 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229790&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7845
2026-01-12 22:56:38.227 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160369868?api_key=51job&timestamp=1768229797 status=200 resp_size=5589
2026-01-12 22:56:38.449 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229798&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-12 22:56:42.711 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160371871?api_key=51job&timestamp=1768229802 status=200 resp_size=5194
2026-01-12 22:56:43.018 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229802&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-12 22:56:51.358 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370349?api_key=51job&timestamp=1768229810 status=200 resp_size=5556
2026-01-12 22:56:51.594 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229811&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-12 22:56:56.732 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170204019?api_key=51job&timestamp=1768229816 status=200 resp_size=6332
2026-01-12 22:56:57.039 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229816&companyId=5310383&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10138
2026-01-12 22:57:04.998 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160370126?api_key=51job&timestamp=1768229824 status=200 resp_size=5640
2026-01-12 22:57:05.186 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229824&companyId=9237190&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2582
2026-01-12 22:57:08.932 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170180102?api_key=51job&timestamp=1768229828 status=200 resp_size=5171
2026-01-12 22:57:09.078 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229828&companyId=10108008&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3416
2026-01-12 22:57:15.682 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158771407?api_key=51job&timestamp=1768229834 status=200 resp_size=8637
2026-01-12 22:57:16.362 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229835&companyId=2928943&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8069
2026-01-12 22:57:26.224 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170231408?api_key=51job&timestamp=1768229845 status=200 resp_size=6170
2026-01-12 22:57:26.495 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229846&companyId=6883541&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=15527
2026-01-12 22:57:36.073 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169411076?api_key=51job&timestamp=1768229855 status=200 resp_size=6609
2026-01-12 22:57:36.504 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229856&companyId=9786290&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3407
2026-01-12 22:57:45.070 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161323778?api_key=51job&timestamp=1768229864 status=200 resp_size=5893
2026-01-12 22:57:45.274 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229865&companyId=5277541&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5138
2026-01-12 22:57:53.976 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163138192?api_key=51job&timestamp=1768229873 status=200 resp_size=5813
2026-01-12 22:57:54.132 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229873&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 22:58:01.301 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170195716?api_key=51job&timestamp=1768229880 status=200 resp_size=8323
2026-01-12 22:58:01.573 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229881&companyId=6192298&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4023
2026-01-12 22:58:11.690 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170102899?api_key=51job&timestamp=1768229890 status=200 resp_size=6056
2026-01-12 22:58:11.908 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229891&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-12 22:58:22.443 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161941101?api_key=51job&timestamp=1768229901 status=200 resp_size=4922
2026-01-12 22:58:22.648 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229902&companyId=9330961&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3292
2026-01-12 22:58:26.934 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126563?api_key=51job&timestamp=1768229906 status=200 resp_size=6081
2026-01-12 22:58:27.154 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229906&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-12 22:58:32.281 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804396?api_key=51job&timestamp=1768229912 status=200 resp_size=6417
2026-01-12 22:58:32.481 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229912&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 22:58:37.692 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167300668?api_key=51job&timestamp=1768229917 status=200 resp_size=7054
2026-01-12 22:58:37.906 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229917&companyId=8383779&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2883
2026-01-12 22:58:39.442 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164959350?api_key=51job&timestamp=1768229919 status=200 resp_size=5738
2026-01-12 22:58:39.651 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229919&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 22:58:49.378 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158438599?api_key=51job&timestamp=1768229928 status=200 resp_size=5476
2026-01-12 22:58:49.692 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229929&companyId=8059756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6355
2026-01-12 22:58:49.692 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 1 页数据，包含详细信息的数据条数: 20
2026-01-12 22:58:49.750 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 22:58:49.751 | INFO     | __main__:crawl_multiple_pages:1027 - 检测到API返回totalCount: 501 | 计算需要爬取: 26 页 (每页 20 条) | 预计最大数据: 520 条
2026-01-12 22:58:49.751 | INFO     | __main__:crawl_multiple_pages:1031 - 第 1 页获取到 20 个职位 | 累计: 20 个
2026-01-12 22:58:59.690 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 9.94 秒后继续...
2026-01-12 22:58:59.690 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 2/26 页...
2026-01-12 22:58:59.690 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 22:58:59.817 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=2, 页大小=20, 地区=81400, 工作类型=0565
2026-01-12 22:59:00.380 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:59:01.508 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:59:03.709 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 22:59:03.709 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 22:59:04.257 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768229939 status=200 resp_size=112032
2026-01-12 22:59:04.257 | INFO     | __main__:get_recommend_jobs:747 - 第 2 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 义乌(81400) | 职能: 夹具工程师(0565)
2026-01-12 22:59:04.469 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050033?api_key=51job&timestamp=1768229944 status=200 resp_size=6037
2026-01-12 22:59:04.821 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229944&companyId=10126395&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2865
2026-01-12 22:59:13.117 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169175063?api_key=51job&timestamp=1768229952 status=200 resp_size=6268
2026-01-12 22:59:13.313 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229953&companyId=10007015&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5841
2026-01-12 22:59:20.104 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167697904?api_key=51job&timestamp=1768229959 status=200 resp_size=5738
2026-01-12 22:59:20.332 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229960&companyId=9502700&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3664
2026-01-12 22:59:28.489 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163080620?api_key=51job&timestamp=1768229967 status=200 resp_size=5638
2026-01-12 22:59:28.797 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229968&companyId=9474539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4824
2026-01-12 22:59:36.741 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170208755?api_key=51job&timestamp=1768229976 status=200 resp_size=6388
2026-01-12 22:59:36.907 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229976&companyId=10101579&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3029
2026-01-12 22:59:46.362 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170132288?api_key=51job&timestamp=1768229985 status=200 resp_size=5102
2026-01-12 22:59:46.542 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229986&companyId=10140534&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 22:59:54.729 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165612676?api_key=51job&timestamp=1768229993 status=200 resp_size=6273
2026-01-12 22:59:54.975 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229994&companyId=8622255&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4814
2026-01-12 22:59:57.051 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160041583?api_key=51job&timestamp=1768229996 status=200 resp_size=5373
2026-01-12 22:59:57.266 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768229997&companyId=8395725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3112
2026-01-12 23:00:00.851 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167368039?api_key=51job&timestamp=1768230000 status=200 resp_size=6433
2026-01-12 23:00:01.085 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230000&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-12 23:00:05.130 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165890498?api_key=51job&timestamp=1768230004 status=200 resp_size=5182
2026-01-12 23:00:05.546 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230005&companyId=9771350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6796
2026-01-12 23:00:08.005 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168858074?api_key=51job&timestamp=1768230007 status=200 resp_size=5022
2026-01-12 23:00:08.631 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230008&companyId=9520344&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2988
2026-01-12 23:00:12.862 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159683606?api_key=51job&timestamp=1768230010 status=200 resp_size=6134
2026-01-12 23:00:13.637 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230012&companyId=8006731&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2565
2026-01-12 23:00:27.605 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323849?api_key=51job&timestamp=1768230020 status=200 resp_size=7193
2026-01-12 23:00:30.748 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230027&companyId=8899718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8455
2026-01-12 23:00:36.935 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160078565?api_key=51job&timestamp=1768230036 status=200 resp_size=5613
2026-01-12 23:00:37.207 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230036&companyId=9199595&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3460
2026-01-12 23:00:44.406 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166840546?api_key=51job&timestamp=1768230043 status=200 resp_size=5128
2026-01-12 23:00:44.660 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230044&companyId=9248576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2692
2026-01-12 23:00:48.466 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166855655?api_key=51job&timestamp=1768230048 status=200 resp_size=5966
2026-01-12 23:00:48.709 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230048&companyId=9551781&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2660
2026-01-12 23:00:56.593 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170080054?api_key=51job&timestamp=1768230055 status=200 resp_size=6188
2026-01-12 23:00:56.789 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230056&companyId=10121432&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5374
2026-01-12 23:01:01.265 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166173609?api_key=51job&timestamp=1768230060 status=200 resp_size=5623
2026-01-12 23:01:01.476 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230061&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-12 23:01:06.280 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041266?api_key=51job&timestamp=1768230065 status=200 resp_size=5839
2026-01-12 23:01:06.483 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230066&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 23:01:10.175 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170093398?api_key=51job&timestamp=1768230069 status=200 resp_size=5407
2026-01-12 23:01:10.479 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230070&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-12 23:01:10.479 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 2 页数据，包含详细信息的数据条数: 20
2026-01-12 23:01:10.528 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 23:01:10.528 | INFO     | __main__:crawl_multiple_pages:1031 - 第 2 页获取到 20 个职位 | 累计: 40 个
2026-01-12 23:01:19.869 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 9.34 秒后继续...
2026-01-12 23:01:19.869 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 3/26 页...
2026-01-12 23:01:19.869 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 23:01:19.893 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=3, 页大小=20, 地区=81400, 工作类型=0565
2026-01-12 23:01:20.762 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:01:21.971 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:01:24.201 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:01:24.202 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 23:01:24.741 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768230079 status=200 resp_size=114501
2026-01-12 23:01:24.742 | INFO     | __main__:get_recommend_jobs:747 - 第 3 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 义乌(81400) | 职能: 夹具工程师(0565)
2026-01-12 23:01:25.021 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170076491?api_key=51job&timestamp=1768230084 status=200 resp_size=6980
2026-01-12 23:01:25.254 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230085&companyId=2429099&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6736
2026-01-12 23:01:27.278 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168253127?api_key=51job&timestamp=1768230087 status=200 resp_size=5619
2026-01-12 23:01:27.584 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230087&companyId=9848116&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3803
2026-01-12 23:01:37.100 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166113366?api_key=51job&timestamp=1768230096 status=200 resp_size=5704
2026-01-12 23:01:37.301 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230097&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-12 23:01:47.905 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166179432?api_key=51job&timestamp=1768230106 status=200 resp_size=5609
2026-01-12 23:01:48.145 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230107&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-12 23:01:57.066 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169609507?api_key=51job&timestamp=1768230116 status=200 resp_size=5894
2026-01-12 23:01:57.263 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230117&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:02:07.186 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322119?api_key=51job&timestamp=1768230126 status=200 resp_size=6499
2026-01-12 23:02:07.392 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230127&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-12 23:02:14.732 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166519728?api_key=51job&timestamp=1768230133 status=200 resp_size=5519
2026-01-12 23:02:15.023 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230134&companyId=9816763&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-12 23:02:25.507 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041305?api_key=51job&timestamp=1768230144 status=200 resp_size=5799
2026-01-12 23:02:25.712 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230145&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 23:02:29.588 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169652013?api_key=51job&timestamp=1768230149 status=200 resp_size=6336
2026-01-12 23:02:29.878 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230149&companyId=5882528&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7948
2026-01-12 23:02:34.329 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167246198?api_key=51job&timestamp=1768230154 status=200 resp_size=5687
2026-01-12 23:02:34.539 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230154&companyId=9856387&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3703
2026-01-12 23:02:37.543 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166822227?api_key=51job&timestamp=1768230157 status=200 resp_size=6312
2026-01-12 23:02:38.778 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230157&companyId=9210539&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3106
2026-01-12 23:02:48.316 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161788718?api_key=51job&timestamp=1768230167 status=200 resp_size=5148
2026-01-12 23:02:48.521 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230168&companyId=9366134&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3620
2026-01-12 23:02:49.827 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169657873?api_key=51job&timestamp=1768230169 status=200 resp_size=6452
2026-01-12 23:02:50.072 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230169&companyId=10094056&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6505
2026-01-12 23:02:54.229 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/164041169?api_key=51job&timestamp=1768230174 status=200 resp_size=5967
2026-01-12 23:02:54.404 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230174&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 23:02:59.074 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163322023?api_key=51job&timestamp=1768230178 status=200 resp_size=5851
2026-01-12 23:02:59.274 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230179&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-12 23:03:10.075 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163273848?api_key=51job&timestamp=1768230189 status=200 resp_size=5179
2026-01-12 23:03:10.300 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230190&companyId=9043175&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2725
2026-01-12 23:03:17.021 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170200018?api_key=51job&timestamp=1768230196 status=200 resp_size=8501
2026-01-12 23:03:17.272 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230197&companyId=9861992&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4825
2026-01-12 23:03:23.725 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158054032?api_key=51job&timestamp=1768230202 status=200 resp_size=6008
2026-01-12 23:03:23.961 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230203&companyId=9057358&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2681
2026-01-12 23:03:34.245 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857801?api_key=51job&timestamp=1768230213 status=200 resp_size=6055
2026-01-12 23:03:34.436 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230214&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 23:03:41.742 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166174784?api_key=51job&timestamp=1768230221 status=200 resp_size=5337
2026-01-12 23:03:41.913 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230221&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-12 23:03:41.918 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 3 页数据，包含详细信息的数据条数: 20
2026-01-12 23:03:41.958 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 23:03:41.963 | INFO     | __main__:crawl_multiple_pages:1031 - 第 3 页获取到 20 个职位 | 累计: 60 个
2026-01-12 23:03:49.044 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 7.08 秒后继续...
2026-01-12 23:03:49.044 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 4/26 页...
2026-01-12 23:03:49.045 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 23:03:49.086 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=4, 页大小=20, 地区=81400, 工作类型=0565
2026-01-12 23:03:51.200 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:03:52.804 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:03:55.409 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:03:55.409 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 23:03:56.639 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768230229 status=200 resp_size=111196
2026-01-12 23:03:56.639 | INFO     | __main__:get_recommend_jobs:747 - 第 4 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 义乌(81400) | 职能: 夹具工程师(0565)
2026-01-12 23:03:57.092 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447969?api_key=51job&timestamp=1768230236 status=200 resp_size=5746
2026-01-12 23:03:57.648 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230237&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:04:02.205 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158370406?api_key=51job&timestamp=1768230241 status=200 resp_size=5731
2026-01-12 23:04:04.095 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230242&companyId=9071363&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2882
2026-01-12 23:04:07.745 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126251?api_key=51job&timestamp=1768230246 status=200 resp_size=5762
2026-01-12 23:04:09.526 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230247&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-12 23:04:17.122 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954416?api_key=51job&timestamp=1768230256 status=200 resp_size=5946
2026-01-12 23:04:17.288 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230257&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 23:04:22.275 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169079604?api_key=51job&timestamp=1768230262 status=200 resp_size=5295
2026-01-12 23:04:22.450 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230262&companyId=2861122&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4822
2026-01-12 23:04:29.428 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166111168?api_key=51job&timestamp=1768230268 status=200 resp_size=5733
2026-01-12 23:04:29.618 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230269&companyId=9055949&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3081
2026-01-12 23:04:40.308 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163285553?api_key=51job&timestamp=1768230279 status=200 resp_size=6173
2026-01-12 23:04:40.544 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230280&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-12 23:04:49.869 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161093063?api_key=51job&timestamp=1768230289 status=200 resp_size=4899
2026-01-12 23:04:50.065 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230289&companyId=9298193&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2762
2026-01-12 23:04:59.749 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169555046?api_key=51job&timestamp=1768230299 status=200 resp_size=5464
2026-01-12 23:04:59.958 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230299&companyId=6453633&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7496
2026-01-12 23:05:04.142 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954338?api_key=51job&timestamp=1768230303 status=200 resp_size=5238
2026-01-12 23:05:04.391 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230304&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 23:05:13.806 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167930682?api_key=51job&timestamp=1768230312 status=200 resp_size=6030
2026-01-12 23:05:13.980 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230313&companyId=6966653&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3852
2026-01-12 23:05:21.547 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163286165?api_key=51job&timestamp=1768230320 status=200 resp_size=5488
2026-01-12 23:05:21.754 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230321&companyId=9430969&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2788
2026-01-12 23:05:29.928 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169107661?api_key=51job&timestamp=1768230329 status=200 resp_size=6874
2026-01-12 23:05:30.158 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230329&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:05:40.610 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170097130?api_key=51job&timestamp=1768230339 status=200 resp_size=5278
2026-01-12 23:05:40.918 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230340&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-12 23:05:43.888 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163954601?api_key=51job&timestamp=1768230343 status=200 resp_size=5640
2026-01-12 23:05:44.198 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230343&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 23:05:47.777 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163857296?api_key=51job&timestamp=1768230347 status=200 resp_size=5894
2026-01-12 23:05:48.026 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230347&companyId=9563958&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3573
2026-01-12 23:06:03.295 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169955913?api_key=51job&timestamp=1768230355 status=200 resp_size=5654
2026-01-12 23:06:05.682 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230363&companyId=10047077&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4568
2026-01-12 23:06:10.222 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166890851?api_key=51job&timestamp=1768230368 status=200 resp_size=6669
2026-01-12 23:06:16.865 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230370&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8122
2026-01-12 23:06:21.467 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165259347?api_key=51job&timestamp=1768230378 status=200 resp_size=4201
2026-01-12 23:06:23.964 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230381&companyId=148020&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7420
2026-01-12 23:06:33.245 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166865703?api_key=51job&timestamp=1768230392 status=200 resp_size=6444
2026-01-12 23:06:33.448 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230393&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8122
2026-01-12 23:06:33.449 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 4 页数据，包含详细信息的数据条数: 20
2026-01-12 23:06:41.631 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 23:06:41.631 | INFO     | __main__:crawl_multiple_pages:1031 - 第 4 页获取到 20 个职位 | 累计: 80 个
2026-01-12 23:06:44.317 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 2.68 秒后继续...
2026-01-12 23:06:44.317 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 5/26 页...
2026-01-12 23:06:44.317 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 23:06:44.356 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=5, 页大小=20, 地区=81400, 工作类型=0565
2026-01-12 23:06:44.922 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:06:46.039 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:06:48.168 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:06:48.168 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 23:06:48.571 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768230404 status=200 resp_size=140372
2026-01-12 23:06:48.573 | INFO     | __main__:get_recommend_jobs:747 - 第 5 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 义乌(81400) | 职能: 夹具工程师(0565)
2026-01-12 23:06:48.756 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153297297?api_key=51job&timestamp=1768230408 status=200 resp_size=5925
2026-01-12 23:06:48.930 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230408&companyId=13201&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10777
2026-01-12 23:07:00.197 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163795744?api_key=51job&timestamp=1768230414 status=200 resp_size=6201
2026-01-12 23:07:03.521 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230420&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
2026-01-12 23:07:06.498 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166894628?api_key=51job&timestamp=1768230424 status=200 resp_size=6410
2026-01-12 23:07:11.724 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230426&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8122
2026-01-12 23:07:16.772 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166339728?api_key=51job&timestamp=1768230435 status=200 resp_size=6079
2026-01-12 23:07:28.958 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230436&companyId=9159221&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2699
2026-01-12 23:07:35.990 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167867265?api_key=51job&timestamp=1768230453 status=200 resp_size=7774
2026-01-12 23:07:39.703 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230455&companyId=5713012&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11344
2026-01-12 23:07:53.091 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166888109?api_key=51job&timestamp=1768230465 status=200 resp_size=6551
2026-01-12 23:07:54.521 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230473&companyId=9842362&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8122
2026-01-12 23:07:58.625 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169552998?api_key=51job&timestamp=1768230475 status=200 resp_size=5844
2026-01-12 23:08:00.059 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230478&companyId=10081630&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2698
2026-01-12 23:08:02.919 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170126632?api_key=51job&timestamp=1768230481 status=200 resp_size=5923
2026-01-12 23:08:04.292 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230482&companyId=10121200&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2927
2026-01-12 23:08:12.027 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170002057?api_key=51job&timestamp=1768230488 status=200 resp_size=6064
2026-01-12 23:08:13.368 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230492&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:08:17.872 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170210409?api_key=51job&timestamp=1768230497 status=200 resp_size=5508
2026-01-12 23:08:18.364 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230497&companyId=10143440&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2501
2026-01-12 23:08:27.623 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142783157?api_key=51job&timestamp=1768230506 status=200 resp_size=6874
2026-01-12 23:08:27.880 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230507&companyId=4284907&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8133
2026-01-12 23:08:36.114 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167749069?api_key=51job&timestamp=1768230515 status=200 resp_size=6231
2026-01-12 23:08:36.299 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230516&companyId=296713&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7824
2026-01-12 23:08:42.405 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170129561?api_key=51job&timestamp=1768230521 status=200 resp_size=9214
2026-01-12 23:08:42.638 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230522&companyId=2541073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12832
2026-01-12 23:08:50.912 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755292?api_key=51job&timestamp=1768230529 status=200 resp_size=6491
2026-01-12 23:08:51.088 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230530&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:09:01.087 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170128290?api_key=51job&timestamp=1768230540 status=200 resp_size=10186
2026-01-12 23:09:01.288 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230541&companyId=5844795&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5637
2026-01-12 23:09:10.479 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163897479?api_key=51job&timestamp=1768230549 status=200 resp_size=7105
2026-01-12 23:09:10.721 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230550&companyId=2501599&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5304
2026-01-12 23:09:18.144 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/134935273?api_key=51job&timestamp=1768230557 status=200 resp_size=9049
2026-01-12 23:09:18.410 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230558&companyId=2265313&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7521
2026-01-12 23:09:25.647 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169851423?api_key=51job&timestamp=1768230565 status=200 resp_size=6780
2026-01-12 23:09:25.831 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230565&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:09:36.741 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169604659?api_key=51job&timestamp=1768230575 status=200 resp_size=7166
2026-01-12 23:09:37.030 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230576&companyId=2016195&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4559
2026-01-12 23:09:42.164 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169089492?api_key=51job&timestamp=1768230581 status=200 resp_size=6821
2026-01-12 23:09:42.376 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230582&companyId=9768323&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9447
2026-01-12 23:09:42.376 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 5 页数据，包含详细信息的数据条数: 20
2026-01-12 23:09:42.477 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 23:09:42.477 | INFO     | __main__:crawl_multiple_pages:1031 - 第 5 页获取到 20 个职位 | 累计: 100 个
2026-01-12 23:09:50.456 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 7.97 秒后继续...
2026-01-12 23:09:50.456 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 6/26 页...
2026-01-12 23:09:50.457 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 23:09:50.512 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=6, 页大小=20, 地区=81400, 工作类型=0565
2026-01-12 23:09:51.156 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:09:52.347 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:09:54.505 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:09:54.505 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 23:09:54.969 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768230590 status=200 resp_size=161299
2026-01-12 23:09:54.974 | INFO     | __main__:get_recommend_jobs:747 - 第 6 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 义乌(81400) | 职能: 夹具工程师(0565)
2026-01-12 23:09:55.164 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170017735?api_key=51job&timestamp=1768230594 status=200 resp_size=6257
2026-01-12 23:09:55.354 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230595&companyId=10126395&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2865
2026-01-12 23:10:01.316 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170147815?api_key=51job&timestamp=1768230600 status=200 resp_size=5429
2026-01-12 23:10:01.513 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230601&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:10:08.147 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169935993?api_key=51job&timestamp=1768230607 status=200 resp_size=6591
2026-01-12 23:10:08.381 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230608&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
2026-01-12 23:10:17.297 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/130474917?api_key=51job&timestamp=1768230616 status=200 resp_size=6755
2026-01-12 23:10:17.521 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230617&companyId=6144374&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7123
2026-01-12 23:10:22.845 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169927328?api_key=51job&timestamp=1768230622 status=200 resp_size=9189
2026-01-12 23:10:23.137 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230622&companyId=1451330&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7271
2026-01-12 23:10:30.922 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169755029?api_key=51job&timestamp=1768230630 status=200 resp_size=7002
2026-01-12 23:10:31.102 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230630&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:10:33.371 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168021501?api_key=51job&timestamp=1768230633 status=200 resp_size=5732
2026-01-12 23:10:33.580 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230633&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
2026-01-12 23:10:35.372 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/159347190?api_key=51job&timestamp=1768230635 status=200 resp_size=5262
2026-01-12 23:10:35.625 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230635&companyId=3888892&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12331
2026-01-12 23:10:44.944 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169855968?api_key=51job&timestamp=1768230643 status=200 resp_size=6074
2026-01-12 23:10:45.259 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230644&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
2026-01-12 23:10:53.854 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170158528?api_key=51job&timestamp=1768230653 status=200 resp_size=6570
2026-01-12 23:10:54.039 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230653&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:11:01.562 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170167516?api_key=51job&timestamp=1768230660 status=200 resp_size=6493
2026-01-12 23:11:01.839 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230661&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
2026-01-12 23:11:06.551 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170018599?api_key=51job&timestamp=1768230666 status=200 resp_size=6937
2026-01-12 23:11:06.746 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230666&companyId=323725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6484
2026-01-12 23:11:09.330 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168447992?api_key=51job&timestamp=1768230669 status=200 resp_size=5513
2026-01-12 23:11:09.623 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230669&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:11:11.055 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169860176?api_key=51job&timestamp=1768230670 status=200 resp_size=6601
2026-01-12 23:11:11.260 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230671&companyId=1128753&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9600
2026-01-12 23:11:13.926 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/66521396?api_key=51job&timestamp=1768230673 status=200 resp_size=6694
2026-01-12 23:11:14.227 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230673&companyId=3220556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5999
2026-01-12 23:11:23.074 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169259937?api_key=51job&timestamp=1768230682 status=200 resp_size=5729
2026-01-12 23:11:23.341 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230683&companyId=5777317&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7920
2026-01-12 23:11:29.209 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146679050?api_key=51job&timestamp=1768230688 status=200 resp_size=7569
2026-01-12 23:11:29.364 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230689&companyId=5726042&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5894
2026-01-12 23:11:39.102 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170173478?api_key=51job&timestamp=1768230698 status=200 resp_size=6707
2026-01-12 23:11:39.302 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230699&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:11:49.727 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153925506?api_key=51job&timestamp=1768230708 status=200 resp_size=5809
2026-01-12 23:11:49.946 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230709&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13653
2026-01-12 23:11:59.247 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170129464?api_key=51job&timestamp=1768230718 status=200 resp_size=8602
2026-01-12 23:11:59.442 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230719&companyId=2541073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12832
2026-01-12 23:11:59.442 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 6 页数据，包含详细信息的数据条数: 20
2026-01-12 23:11:59.562 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 23:11:59.562 | INFO     | __main__:crawl_multiple_pages:1031 - 第 6 页获取到 20 个职位 | 累计: 120 个
2026-01-12 23:12:02.580 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 3.01 秒后继续...
2026-01-12 23:12:02.582 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 7/26 页...
2026-01-12 23:12:02.582 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 23:12:02.628 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=7, 页大小=20, 地区=81400, 工作类型=0565
2026-01-12 23:12:07.737 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:12:09.396 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:12:13.611 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:12:13.611 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 23:12:17.242 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768230722 status=200 resp_size=151330
2026-01-12 23:12:17.242 | INFO     | __main__:get_recommend_jobs:747 - 第 7 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 义乌(81400) | 职能: 夹具工程师(0565)
2026-01-12 23:12:18.283 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168488694?api_key=51job&timestamp=1768230737 status=200 resp_size=6853
2026-01-12 23:12:19.234 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230738&companyId=2036019&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4474
2026-01-12 23:12:27.958 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169950080?api_key=51job&timestamp=1768230747 status=200 resp_size=6302
2026-01-12 23:12:28.172 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230747&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:12:29.804 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169856264?api_key=51job&timestamp=1768230749 status=200 resp_size=5916
2026-01-12 23:12:30.008 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230749&companyId=2383709&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9616
2026-01-12 23:12:33.487 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170139062?api_key=51job&timestamp=1768230752 status=200 resp_size=7778
2026-01-12 23:12:33.644 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230753&companyId=10110096&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8782
2026-01-12 23:12:43.214 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163530512?api_key=51job&timestamp=1768230762 status=200 resp_size=5225
2026-01-12 23:12:43.524 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230763&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13653
2026-01-12 23:12:50.854 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169844681?api_key=51job&timestamp=1768230770 status=200 resp_size=6276
2026-01-12 23:12:51.103 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230770&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:12:59.099 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162626856?api_key=51job&timestamp=1768230778 status=200 resp_size=5328
2026-01-12 23:12:59.395 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230779&companyId=9437588&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5908
2026-01-12 23:13:05.513 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163452370?api_key=51job&timestamp=1768230784 status=200 resp_size=5948
2026-01-12 23:13:05.742 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230785&companyId=3031347&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6454
2026-01-12 23:13:07.354 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169698421?api_key=51job&timestamp=1768230787 status=200 resp_size=7210
2026-01-12 23:13:07.555 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230787&companyId=10098645&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2735
2026-01-12 23:13:14.845 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170148331?api_key=51job&timestamp=1768230793 status=200 resp_size=6242
2026-01-12 23:13:15.103 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230794&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:13:22.539 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170129002?api_key=51job&timestamp=1768230801 status=200 resp_size=9018
2026-01-12 23:13:22.841 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230802&companyId=2541073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12832
2026-01-12 23:13:29.405 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157376468?api_key=51job&timestamp=1768230808 status=200 resp_size=6716
2026-01-12 23:13:29.596 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230809&companyId=2297693&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10416
2026-01-12 23:13:34.106 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169414013?api_key=51job&timestamp=1768230813 status=200 resp_size=10475
2026-01-12 23:13:34.262 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230814&companyId=1451330&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7271
2026-01-12 23:13:43.758 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169781093?api_key=51job&timestamp=1768230822 status=200 resp_size=8830
2026-01-12 23:13:44.041 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230823&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:13:46.741 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168361598?api_key=51job&timestamp=1768230826 status=200 resp_size=5980
2026-01-12 23:13:46.934 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230826&companyId=2036019&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4474
2026-01-12 23:13:54.076 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168097451?api_key=51job&timestamp=1768230833 status=200 resp_size=5688
2026-01-12 23:13:54.391 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230834&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13653
2026-01-12 23:14:02.677 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169303036?api_key=51job&timestamp=1768230842 status=200 resp_size=8231
2026-01-12 23:14:02.825 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230842&companyId=323725&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6484
2026-01-12 23:14:06.022 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169917574?api_key=51job&timestamp=1768230845 status=200 resp_size=6563
2026-01-12 23:14:06.167 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230846&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:14:16.793 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156555837?api_key=51job&timestamp=1768230855 status=200 resp_size=7527
2026-01-12 23:14:17.019 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230856&companyId=692384&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5000
2026-01-12 23:14:27.418 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160005147?api_key=51job&timestamp=1768230866 status=200 resp_size=7517
2026-01-12 23:14:27.689 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230867&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
2026-01-12 23:14:27.690 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 7 页数据，包含详细信息的数据条数: 20
2026-01-12 23:14:27.802 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 23:14:27.803 | INFO     | __main__:crawl_multiple_pages:1031 - 第 7 页获取到 20 个职位 | 累计: 140 个
2026-01-12 23:14:29.366 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 1.56 秒后继续...
2026-01-12 23:14:29.366 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 8/26 页...
2026-01-12 23:14:29.366 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 23:14:29.394 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=8, 页大小=20, 地区=81400, 工作类型=0565
2026-01-12 23:14:29.998 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:14:31.168 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:14:33.399 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:14:33.399 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 23:14:33.951 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768230869 status=200 resp_size=144474
2026-01-12 23:14:33.955 | INFO     | __main__:get_recommend_jobs:747 - 第 8 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 义乌(81400) | 职能: 夹具工程师(0565)
2026-01-12 23:14:34.151 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170115317?api_key=51job&timestamp=1768230873 status=200 resp_size=10974
2026-01-12 23:14:34.428 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230874&companyId=1451330&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7271
2026-01-12 23:14:40.346 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169851617?api_key=51job&timestamp=1768230879 status=200 resp_size=6463
2026-01-12 23:14:40.509 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230880&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:14:49.290 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156927299?api_key=51job&timestamp=1768230888 status=200 resp_size=5621
2026-01-12 23:14:49.438 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230889&companyId=129018&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13653
2026-01-12 23:14:51.113 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151665?api_key=51job&timestamp=1768230890 status=200 resp_size=6736
2026-01-12 23:14:51.322 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230891&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
2026-01-12 23:15:00.844 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168323197?api_key=51job&timestamp=1768230900 status=200 resp_size=6198
2026-01-12 23:15:01.050 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230900&companyId=9406941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7134
2026-01-12 23:15:05.490 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166777021?api_key=51job&timestamp=1768230905 status=200 resp_size=5017
2026-01-12 23:15:05.680 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230905&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:15:13.951 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163971898?api_key=51job&timestamp=1768230913 status=200 resp_size=5683
2026-01-12 23:15:14.157 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230913&companyId=2112153&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10557
2026-01-12 23:15:22.063 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170154445?api_key=51job&timestamp=1768230921 status=200 resp_size=6702
2026-01-12 23:15:22.345 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230922&companyId=3577312&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7422
2026-01-12 23:15:25.826 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166642859?api_key=51job&timestamp=1768230925 status=200 resp_size=5146
2026-01-12 23:15:26.031 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230925&companyId=9768996&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5442
2026-01-12 23:15:27.917 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170150838?api_key=51job&timestamp=1768230927 status=200 resp_size=6519
2026-01-12 23:15:28.187 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230927&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:15:36.887 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169516936?api_key=51job&timestamp=1768230936 status=200 resp_size=8382
2026-01-12 23:15:37.078 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230936&companyId=8489874&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6388
2026-01-12 23:15:46.820 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169989833?api_key=51job&timestamp=1768230945 status=200 resp_size=7332
2026-01-12 23:15:47.125 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230946&companyId=5937718&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10582
2026-01-12 23:16:01.157 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142100712?api_key=51job&timestamp=1768230953 status=200 resp_size=5924
2026-01-12 23:16:31.174 | ERROR    | __main__:_make_request:632 - 请求异常 (尝试 1/3): The read operation timed out
2026-01-12 23:16:40.022 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768230961&companyId=2509359&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6068
2026-01-12 23:16:47.232 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170124203?api_key=51job&timestamp=1768231006 status=200 resp_size=5682
2026-01-12 23:16:47.440 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231007&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:16:54.820 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169948611?api_key=51job&timestamp=1768231014 status=200 resp_size=6442
2026-01-12 23:16:54.966 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231014&companyId=7226894&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6269
2026-01-12 23:16:59.315 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/67857747?api_key=51job&timestamp=1768231019 status=200 resp_size=6043
2026-01-12 23:16:59.520 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231019&companyId=2319747&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4408
2026-01-12 23:17:39.104 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169830137?api_key=51job&timestamp=1768231027 status=200 resp_size=5893
2026-01-12 23:17:40.280 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231059&companyId=10109694&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5455
2026-01-12 23:18:13.793 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169804679?api_key=51job&timestamp=1768231063 status=200 resp_size=6519
2026-01-12 23:18:21.544 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231093&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:18:35.469 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169948859?api_key=51job&timestamp=1768231109 status=200 resp_size=5946
2026-01-12 23:18:37.574 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231115&companyId=10111983&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4662
2026-01-12 23:18:44.787 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162576189?api_key=51job&timestamp=1768231124 status=200 resp_size=6067
2026-01-12 23:18:44.963 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231124&companyId=8399556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5849
2026-01-12 23:18:44.963 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 8 页数据，包含详细信息的数据条数: 20
2026-01-12 23:18:45.033 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 23:18:45.033 | INFO     | __main__:crawl_multiple_pages:1031 - 第 8 页获取到 20 个职位 | 累计: 160 个
2026-01-12 23:18:52.852 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 7.82 秒后继续...
2026-01-12 23:18:52.852 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 9/26 页...
2026-01-12 23:18:52.853 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 23:18:52.878 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=9, 页大小=20, 地区=81400, 工作类型=0565
2026-01-12 23:18:53.741 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:18:54.956 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:18:57.163 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:18:57.163 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 23:18:57.752 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768231132 status=200 resp_size=135484
2026-01-12 23:18:57.752 | INFO     | __main__:get_recommend_jobs:747 - 第 9 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 义乌(81400) | 职能: 夹具工程师(0565)
2026-01-12 23:18:58.051 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168502014?api_key=51job&timestamp=1768231137 status=200 resp_size=5719
2026-01-12 23:18:58.304 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231138&companyId=9987446&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2808
2026-01-12 23:19:01.888 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168450398?api_key=51job&timestamp=1768231141 status=200 resp_size=6056
2026-01-12 23:19:02.197 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231141&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:19:06.973 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163689976?api_key=51job&timestamp=1768231146 status=200 resp_size=7000
2026-01-12 23:19:07.219 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231146&companyId=2501599&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5304
2026-01-12 23:19:11.493 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170026619?api_key=51job&timestamp=1768231151 status=200 resp_size=5131
2026-01-12 23:19:11.720 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231151&companyId=10007024&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3448
2026-01-12 23:19:20.119 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165894104?api_key=51job&timestamp=1768231159 status=200 resp_size=7141
2026-01-12 23:19:20.450 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231160&companyId=5713012&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11344
2026-01-12 23:20:07.536 | ERROR    | __main__:_make_request:632 - 请求异常 (尝试 1/3): The read operation timed out
2026-01-12 23:20:34.048 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170086850?api_key=51job&timestamp=1768231168 status=200 resp_size=8475
2026-01-12 23:20:48.281 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231234&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:20:55.063 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168927864?api_key=51job&timestamp=1768231254 status=200 resp_size=13120
2026-01-12 23:20:55.350 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231255&companyId=6108855&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9298
2026-01-12 23:20:57.101 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170110379?api_key=51job&timestamp=1768231256 status=200 resp_size=5761
2026-01-12 23:20:57.303 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231257&companyId=3094397&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6080
2026-01-12 23:21:04.120 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162634560?api_key=51job&timestamp=1768231263 status=200 resp_size=5806
2026-01-12 23:21:04.297 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231264&companyId=9437588&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5908
2026-01-12 23:21:15.012 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168834342?api_key=51job&timestamp=1768231274 status=200 resp_size=6159
2026-01-12 23:21:15.208 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231275&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:21:24.742 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170029379?api_key=51job&timestamp=1768231284 status=200 resp_size=10587
2026-01-12 23:21:24.923 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231284&companyId=5844795&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5637
2026-01-12 23:21:33.152 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170224996?api_key=51job&timestamp=1768231292 status=200 resp_size=4633
2026-01-12 23:21:33.441 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231293&companyId=10149556&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2624
2026-01-12 23:21:43.771 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170100789?api_key=51job&timestamp=1768231303 status=200 resp_size=5696
2026-01-12 23:21:43.995 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231303&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:21:47.981 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170037275?api_key=51job&timestamp=1768231307 status=200 resp_size=7971
2026-01-12 23:21:48.159 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231307&companyId=451005&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7845
2026-01-12 23:21:57.122 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170110949?api_key=51job&timestamp=1768231316 status=200 resp_size=6193
2026-01-12 23:21:57.302 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231317&companyId=10137280&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2743
2026-01-12 23:22:05.905 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166843455?api_key=51job&timestamp=1768231324 status=200 resp_size=9540
2026-01-12 23:22:06.211 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231325&companyId=2215274&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8872
2026-01-12 23:22:14.203 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169943708?api_key=51job&timestamp=1768231333 status=200 resp_size=5987
2026-01-12 23:22:14.386 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231334&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:22:25.153 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170120883?api_key=51job&timestamp=1768231344 status=200 resp_size=6606
2026-01-12 23:22:25.463 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231345&companyId=2193352&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7910
2026-01-12 23:22:28.549 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166442404?api_key=51job&timestamp=1768231348 status=200 resp_size=7299
2026-01-12 23:22:28.791 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231348&companyId=2660390&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8331
2026-01-12 23:22:30.272 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170142499?api_key=51job&timestamp=1768231349 status=200 resp_size=5260
2026-01-12 23:22:30.580 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231350&companyId=3863622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7117
2026-01-12 23:22:30.580 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 9 页数据，包含详细信息的数据条数: 20
2026-01-12 23:22:30.650 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 23:22:30.650 | INFO     | __main__:crawl_multiple_pages:1031 - 第 9 页获取到 20 个职位 | 累计: 180 个
2026-01-12 23:22:35.674 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 5.02 秒后继续...
2026-01-12 23:22:35.674 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 10/26 页...
2026-01-12 23:22:35.674 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 23:22:35.694 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=10, 页大小=20, 地区=81400, 工作类型=0565
2026-01-12 23:22:36.313 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:22:37.459 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:22:39.606 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:22:39.607 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 23:22:40.016 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768231355 status=200 resp_size=142665
2026-01-12 23:22:40.016 | WARNING  | __main__:get_recommend_jobs:745 - 第 10 页发现 1 个重复职位（已跳过）
2026-01-12 23:22:40.017 | INFO     | __main__:get_recommend_jobs:747 - 第 10 页成功获取 20 个职位（去重后: 19） | API返回totalCount: 501 (原始值: 501) | 地区: 义乌(81400) | 职能: 夹具工程师(0565)
2026-01-12 23:22:40.280 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169935463?api_key=51job&timestamp=1768231360 status=200 resp_size=5415
2026-01-12 23:22:40.523 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231360&companyId=10093538&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3901
2026-01-12 23:22:44.869 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169089271?api_key=51job&timestamp=1768231364 status=200 resp_size=5364
2026-01-12 23:22:45.087 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231364&companyId=7404484&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3315
2026-01-12 23:22:48.616 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163506006?api_key=51job&timestamp=1768231368 status=200 resp_size=5458
2026-01-12 23:22:48.828 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231368&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
2026-01-12 23:22:57.898 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169046179?api_key=51job&timestamp=1768231377 status=200 resp_size=5670
2026-01-12 23:22:58.038 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231377&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:23:01.097 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170136049?api_key=51job&timestamp=1768231380 status=200 resp_size=7227
2026-01-12 23:23:01.300 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231381&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7988
2026-01-12 23:23:11.355 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169936726?api_key=51job&timestamp=1768231390 status=200 resp_size=6450
2026-01-12 23:23:11.569 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231391&companyId=103026&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10750
2026-01-12 23:23:13.512 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169034126?api_key=51job&timestamp=1768231393 status=200 resp_size=8159
2026-01-12 23:23:13.753 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231393&companyId=7642544&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6020
2026-01-12 23:23:21.844 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170100381?api_key=51job&timestamp=1768231400 status=200 resp_size=5800
2026-01-12 23:23:22.077 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231401&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:23:30.311 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170063888?api_key=51job&timestamp=1768231409 status=200 resp_size=5760
2026-01-12 23:23:30.596 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231410&companyId=10131346&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6066
2026-01-12 23:23:39.076 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170052041?api_key=51job&timestamp=1768231418 status=200 resp_size=7503
2026-01-12 23:23:39.300 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231419&companyId=3967456&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11455
2026-01-12 23:23:45.948 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170050278?api_key=51job&timestamp=1768231425 status=200 resp_size=9486
2026-01-12 23:23:46.256 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231425&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
2026-01-12 23:23:50.591 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170052240?api_key=51job&timestamp=1768231430 status=200 resp_size=5744
2026-01-12 23:23:50.863 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231430&companyId=721810&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10659
2026-01-12 23:23:57.427 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170088704?api_key=51job&timestamp=1768231436 status=200 resp_size=7963
2026-01-12 23:23:57.724 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231437&companyId=103082&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7988
2026-01-12 23:24:05.406 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167151944?api_key=51job&timestamp=1768231444 status=200 resp_size=6706
2026-01-12 23:24:05.577 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231445&companyId=2674552&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11008
2026-01-12 23:24:16.434 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168376540?api_key=51job&timestamp=1768231455 status=200 resp_size=5281
2026-01-12 23:24:16.667 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231456&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
2026-01-12 23:24:28.730 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/158175505?api_key=51job&timestamp=1768231461 status=200 resp_size=7072
2026-01-12 23:24:29.894 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231468&companyId=8489874&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6388
2026-01-12 23:24:34.466 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166020835?api_key=51job&timestamp=1768231473 status=200 resp_size=5277
2026-01-12 23:24:35.620 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231474&companyId=8456370&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3702
2026-01-12 23:24:52.674 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169891207?api_key=51job&timestamp=1768231484 status=200 resp_size=6107
2026-01-12 23:24:53.673 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231492&companyId=5660566&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7132
2026-01-12 23:24:58.616 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/154053858?api_key=51job&timestamp=1768231496 status=200 resp_size=6883
2026-01-12 23:25:03.058 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231498&companyId=3396091&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8076
2026-01-12 23:25:03.058 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 10 页数据，包含详细信息的数据条数: 19
2026-01-12 23:25:11.318 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 19, 响应大小: 113 字节
2026-01-12 23:25:11.319 | INFO     | __main__:crawl_multiple_pages:1031 - 第 10 页获取到 20 个职位 | 累计: 200 个
2026-01-12 23:25:14.495 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 3.17 秒后继续...
2026-01-12 23:25:14.495 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 11/26 页...
2026-01-12 23:25:14.496 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 23:25:14.555 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=11, 页大小=20, 地区=81400, 工作类型=0565
2026-01-12 23:25:15.330 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:25:16.585 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:25:18.763 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:25:18.763 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 23:25:19.258 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768231514 status=200 resp_size=138259
2026-01-12 23:25:19.259 | WARNING  | __main__:get_recommend_jobs:745 - 第 11 页发现 3 个重复职位（已跳过）
2026-01-12 23:25:19.259 | INFO     | __main__:get_recommend_jobs:747 - 第 11 页成功获取 20 个职位（去重后: 17） | API返回totalCount: 501 (原始值: 501) | 地区: 义乌(81400) | 职能: 夹具工程师(0565)
2026-01-12 23:25:19.539 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168631045?api_key=51job&timestamp=1768231519 status=200 resp_size=4916
2026-01-12 23:25:19.849 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231519&companyId=2618304&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11472
2026-01-12 23:25:23.227 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167779092?api_key=51job&timestamp=1768231522 status=200 resp_size=6083
2026-01-12 23:25:23.449 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231523&companyId=9160622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6567
2026-01-12 23:25:25.070 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169357292?api_key=51job&timestamp=1768231524 status=200 resp_size=6485
2026-01-12 23:25:25.377 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231525&companyId=2255809&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8093
2026-01-12 23:25:32.547 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140557776?api_key=51job&timestamp=1768231531 status=200 resp_size=5399
2026-01-12 23:25:32.887 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231532&companyId=2940827&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10918
2026-01-12 23:25:34.785 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170064049?api_key=51job&timestamp=1768231534 status=200 resp_size=5996
2026-01-12 23:25:35.013 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231534&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:25:40.225 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165654123?api_key=51job&timestamp=1768231539 status=200 resp_size=6529
2026-01-12 23:25:40.451 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231540&companyId=3287990&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4030
2026-01-12 23:25:58.775 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169128572?api_key=51job&timestamp=1768231549 status=200 resp_size=5337
2026-01-12 23:26:03.367 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231558&companyId=143102&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7176
2026-01-12 23:26:09.735 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169756645?api_key=51job&timestamp=1768231567 status=200 resp_size=6386
2026-01-12 23:26:14.476 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231569&companyId=5777317&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7920
2026-01-12 23:26:45.669 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166253577?api_key=51job&timestamp=1768231584 status=200 resp_size=6219
2026-01-12 23:26:48.016 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231605&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:27:04.655 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169357579?api_key=51job&timestamp=1768231612 status=200 resp_size=6222
2026-01-12 23:27:18.284 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231624&companyId=5566561&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7998
2026-01-12 23:27:50.579 | ERROR    | __main__:_make_request:632 - 请求异常 (尝试 1/3): The read operation timed out
2026-01-12 23:27:52.318 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168065249?api_key=51job&timestamp=1768231640 status=200 resp_size=5669
2026-01-12 23:27:52.523 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231672&companyId=9435350&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5191
2026-01-12 23:27:57.320 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170233170?api_key=51job&timestamp=1768231677 status=200 resp_size=6536
2026-01-12 23:27:57.500 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231677&companyId=10150186&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6054
2026-01-12 23:27:59.792 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170148568?api_key=51job&timestamp=1768231679 status=200 resp_size=9405
2026-01-12 23:27:59.971 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231679&companyId=5844795&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5637
2026-01-12 23:28:02.455 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169866545?api_key=51job&timestamp=1768231682 status=200 resp_size=6534
2026-01-12 23:28:02.636 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231682&companyId=9885576&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2860
2026-01-12 23:28:06.502 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170134905?api_key=51job&timestamp=1768231686 status=200 resp_size=7369
2026-01-12 23:28:06.757 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231686&companyId=6144374&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7123
2026-01-12 23:28:13.925 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169783777?api_key=51job&timestamp=1768231693 status=200 resp_size=8723
2026-01-12 23:28:14.132 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231693&companyId=4659972&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6242
2026-01-12 23:28:15.563 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169966668?api_key=51job&timestamp=1768231695 status=200 resp_size=9642
2026-01-12 23:28:15.776 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231695&companyId=5844795&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5637
2026-01-12 23:28:15.776 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 11 页数据，包含详细信息的数据条数: 17
2026-01-12 23:28:15.831 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 17, 响应大小: 113 字节
2026-01-12 23:28:15.831 | INFO     | __main__:crawl_multiple_pages:1031 - 第 11 页获取到 20 个职位 | 累计: 220 个
2026-01-12 23:28:21.067 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 5.23 秒后继续...
2026-01-12 23:28:21.067 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 12/26 页...
2026-01-12 23:28:21.067 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 23:28:21.092 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=12, 页大小=20, 地区=81400, 工作类型=0565
2026-01-12 23:28:22.059 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:28:23.247 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:28:25.497 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:28:25.497 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 23:28:26.056 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768231701 status=200 resp_size=132531
2026-01-12 23:28:26.056 | INFO     | __main__:get_recommend_jobs:747 - 第 12 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 义乌(81400) | 职能: 夹具工程师(0565)
2026-01-12 23:28:26.370 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169651289?api_key=51job&timestamp=1768231706 status=200 resp_size=5902
2026-01-12 23:28:26.614 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231706&companyId=13201&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10777
2026-01-12 23:28:32.524 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170026907?api_key=51job&timestamp=1768231711 status=200 resp_size=5719
2026-01-12 23:28:32.779 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231712&companyId=132788&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7174
2026-01-12 23:28:42.566 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166552266?api_key=51job&timestamp=1768231722 status=200 resp_size=6217
2026-01-12 23:28:42.803 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231722&companyId=3287990&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4030
2026-01-12 23:28:45.677 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168784707?api_key=51job&timestamp=1768231725 status=200 resp_size=6166
2026-01-12 23:28:45.874 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231725&companyId=5325756&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13435
2026-01-12 23:28:48.128 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/146059327?api_key=51job&timestamp=1768231727 status=200 resp_size=6885
2026-01-12 23:28:48.338 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231728&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-12 23:28:54.993 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165412012?api_key=51job&timestamp=1768231734 status=200 resp_size=6777
2026-01-12 23:28:55.208 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231734&companyId=3733053&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11037
2026-01-12 23:29:02.677 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/124654690?api_key=51job&timestamp=1768231741 status=200 resp_size=6256
2026-01-12 23:29:02.862 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231742&companyId=5844795&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5637
2026-01-12 23:29:42.007 | ERROR    | __main__:_make_request:632 - 请求异常 (尝试 1/3): _ssl.c:985: The handshake operation timed out
2026-01-12 23:29:42.007 | WARNING  | __main__:_make_request:637 - 检测到代理相关异常: _ssl.c:985: The handshake operation timed out
2026-01-12 23:29:42.007 | WARNING  | __main__:_switch_proxy_and_reinit:423 - 标记代理失败并切换: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 23:29:42.007 | WARNING  | __main__:mark_proxy_failed:204 - 代理 http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818 标记为失败
2026-01-12 23:29:42.007 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 23:29:42.710 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169278821?api_key=51job&timestamp=1768231750 status=200 resp_size=6190
2026-01-12 23:29:42.864 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231782&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
2026-01-12 23:29:49.210 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166654874?api_key=51job&timestamp=1768231788 status=200 resp_size=5396
2026-01-12 23:29:49.447 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231789&companyId=5783320&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7875
2026-01-12 23:30:01.027 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169002674?api_key=51job&timestamp=1768231798 status=200 resp_size=5177
2026-01-12 23:30:02.218 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231801&companyId=10013004&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4124
2026-01-12 23:30:05.319 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703937?api_key=51job&timestamp=1768231804 status=200 resp_size=4986
2026-01-12 23:30:06.450 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231805&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-12 23:30:14.345 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169120888?api_key=51job&timestamp=1768231813 status=200 resp_size=5398
2026-01-12 23:30:14.554 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231814&companyId=2352154&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7248
2026-01-12 23:30:21.122 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163371428?api_key=51job&timestamp=1768231820 status=200 resp_size=6568
2026-01-12 23:30:21.413 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231821&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-12 23:30:24.693 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/141481969?api_key=51job&timestamp=1768231824 status=200 resp_size=5728
2026-01-12 23:30:25.099 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231824&companyId=4248156&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10789
2026-01-12 23:30:30.690 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169135443?api_key=51job&timestamp=1768231830 status=200 resp_size=6933
2026-01-12 23:30:30.845 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231830&companyId=10008871&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7743
2026-01-12 23:30:33.705 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169664424?api_key=51job&timestamp=1768231833 status=200 resp_size=5298
2026-01-12 23:30:33.910 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231833&companyId=9867601&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3911
2026-01-12 23:30:41.910 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163366213?api_key=51job&timestamp=1768231840 status=200 resp_size=6296
2026-01-12 23:30:42.199 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231841&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-12 23:30:49.439 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169117047?api_key=51job&timestamp=1768231848 status=200 resp_size=6588
2026-01-12 23:30:49.684 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231849&companyId=3851409&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6742
2026-01-12 23:30:51.935 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152551025?api_key=51job&timestamp=1768231851 status=200 resp_size=6085
2026-01-12 23:30:52.136 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231851&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-12 23:30:56.507 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162401499?api_key=51job&timestamp=1768231856 status=200 resp_size=5014
2026-01-12 23:30:56.748 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231856&companyId=9348336&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4706
2026-01-12 23:30:56.748 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 12 页数据，包含详细信息的数据条数: 20
2026-01-12 23:30:56.830 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 23:30:56.830 | INFO     | __main__:crawl_multiple_pages:1031 - 第 12 页获取到 20 个职位 | 累计: 240 个
2026-01-12 23:31:05.101 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 8.27 秒后继续...
2026-01-12 23:31:05.101 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 13/26 页...
2026-01-12 23:31:05.101 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 23:31:05.115 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=13, 页大小=20, 地区=81400, 工作类型=0565
2026-01-12 23:31:05.632 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:31:06.744 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:31:08.875 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:31:08.875 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 23:31:09.368 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768231865 status=200 resp_size=114475
2026-01-12 23:31:09.368 | INFO     | __main__:get_recommend_jobs:747 - 第 13 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 义乌(81400) | 职能: 夹具工程师(0565)
2026-01-12 23:31:09.519 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170146440?api_key=51job&timestamp=1768231869 status=200 resp_size=5354
2026-01-12 23:31:09.785 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231869&companyId=9981329&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2922
2026-01-12 23:31:17.095 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162880059?api_key=51job&timestamp=1768231876 status=200 resp_size=4913
2026-01-12 23:31:17.428 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231877&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
2026-01-12 23:31:26.028 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168691099?api_key=51job&timestamp=1768231885 status=200 resp_size=7224
2026-01-12 23:31:26.202 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231886&companyId=9984941&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4680
2026-01-12 23:31:30.021 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166429097?api_key=51job&timestamp=1768231889 status=200 resp_size=5700
2026-01-12 23:31:30.285 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231890&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-12 23:31:37.000 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169379326?api_key=51job&timestamp=1768231896 status=200 resp_size=6948
2026-01-12 23:31:37.291 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231897&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
2026-01-12 23:32:01.030 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170151993?api_key=51job&timestamp=1768231907 status=200 resp_size=5584
2026-01-12 23:32:01.770 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231921&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-12 23:32:09.248 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170152283?api_key=51job&timestamp=1768231928 status=200 resp_size=7138
2026-01-12 23:32:09.418 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231929&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-12 23:32:16.944 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167900472?api_key=51job&timestamp=1768231935 status=200 resp_size=5280
2026-01-12 23:32:17.448 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231936&companyId=5258895&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2944
2026-01-12 23:32:27.672 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/167778416?api_key=51job&timestamp=1768231947 status=200 resp_size=5070
2026-01-12 23:32:27.854 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231947&companyId=9926938&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=4248
2026-01-12 23:32:31.759 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170122855?api_key=51job&timestamp=1768231951 status=200 resp_size=5389
2026-01-12 23:32:31.932 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231951&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-12 23:32:42.319 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168703930?api_key=51job&timestamp=1768231961 status=200 resp_size=4879
2026-01-12 23:32:42.523 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231962&companyId=8222963&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3167
2026-01-12 23:32:52.353 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/163368886?api_key=51job&timestamp=1768231971 status=200 resp_size=6774
2026-01-12 23:32:52.565 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231972&companyId=7605622&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5358
2026-01-12 23:33:01.884 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169346259?api_key=51job&timestamp=1768231981 status=200 resp_size=5308
2026-01-12 23:33:02.190 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231981&companyId=8456370&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3702
2026-01-12 23:33:05.744 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/165587416?api_key=51job&timestamp=1768231985 status=200 resp_size=5770
2026-01-12 23:33:05.977 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231985&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 23:33:09.594 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156198851?api_key=51job&timestamp=1768231989 status=200 resp_size=5467
2026-01-12 23:33:09.796 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231989&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
2026-01-12 23:33:14.531 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169457024?api_key=51job&timestamp=1768231994 status=200 resp_size=5509
2026-01-12 23:33:14.701 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768231994&companyId=8054908&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3024
2026-01-12 23:33:23.324 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/138806906?api_key=51job&timestamp=1768232002 status=200 resp_size=4791
2026-01-12 23:33:23.752 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232003&companyId=4077805&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5160
2026-01-12 23:33:29.014 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168135621?api_key=51job&timestamp=1768232008 status=200 resp_size=6762
2026-01-12 23:33:29.316 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232009&companyId=2295027&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5320
2026-01-12 23:33:35.678 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169441521?api_key=51job&timestamp=1768232015 status=200 resp_size=5183
2026-01-12 23:33:35.872 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232015&companyId=9172238&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3025
2026-01-12 23:33:37.201 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160775568?api_key=51job&timestamp=1768232016 status=200 resp_size=4902
2026-01-12 23:33:37.406 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232017&companyId=4730065&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3038
2026-01-12 23:33:37.406 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 13 页数据，包含详细信息的数据条数: 20
2026-01-12 23:33:37.463 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 23:33:37.463 | INFO     | __main__:crawl_multiple_pages:1031 - 第 13 页获取到 20 个职位 | 累计: 260 个
2026-01-12 23:33:44.767 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 7.30 秒后继续...
2026-01-12 23:33:44.767 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 14/26 页...
2026-01-12 23:33:44.768 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 23:33:44.792 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=14, 页大小=20, 地区=81400, 工作类型=0565
2026-01-12 23:33:45.497 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:33:46.632 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:33:48.876 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:33:48.876 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 23:33:49.410 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768232024 status=200 resp_size=154928
2026-01-12 23:33:49.410 | INFO     | __main__:get_recommend_jobs:747 - 第 14 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 义乌(81400) | 职能: 夹具工程师(0565)
2026-01-12 23:33:49.594 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166951866?api_key=51job&timestamp=1768232029 status=200 resp_size=5280
2026-01-12 23:33:49.766 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232029&companyId=5140750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8232
2026-01-12 23:33:59.323 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/166039131?api_key=51job&timestamp=1768232038 status=200 resp_size=5892
2026-01-12 23:33:59.588 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232039&companyId=9675741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2901
2026-01-12 23:34:09.460 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/161197951?api_key=51job&timestamp=1768232048 status=200 resp_size=7111
2026-01-12 23:34:09.712 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232049&companyId=5922357&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7854
2026-01-12 23:34:11.913 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168746614?api_key=51job&timestamp=1768232051 status=200 resp_size=7664
2026-01-12 23:34:13.140 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232051&companyId=9223073&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5242
2026-01-12 23:34:22.463 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169919865?api_key=51job&timestamp=1768232061 status=200 resp_size=6340
2026-01-12 23:34:22.772 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232062&companyId=9980750&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3913
2026-01-12 23:34:26.169 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169495651?api_key=51job&timestamp=1768232065 status=200 resp_size=4808
2026-01-12 23:34:26.473 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232066&companyId=10030663&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2474
2026-01-12 23:34:28.287 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169233720?api_key=51job&timestamp=1768232068 status=200 resp_size=11961
2026-01-12 23:34:28.607 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232068&companyId=2911011&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7823
2026-01-12 23:34:35.243 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169387554?api_key=51job&timestamp=1768232074 status=200 resp_size=9126
2026-01-12 23:34:35.469 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232075&companyId=9655981&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3362
2026-01-12 23:34:39.156 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168922613?api_key=51job&timestamp=1768232078 status=200 resp_size=6138
2026-01-12 23:34:39.359 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232079&companyId=163471&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6960
2026-01-12 23:34:43.523 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170154072?api_key=51job&timestamp=1768232083 status=200 resp_size=5843
2026-01-12 23:34:43.866 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232083&companyId=10105052&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2583
2026-01-12 23:34:53.797 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/153462006?api_key=51job&timestamp=1768232091 status=200 resp_size=5259
2026-01-12 23:34:54.617 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232093&companyId=2343589&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=11277
2026-01-12 23:35:04.939 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/152360694?api_key=51job&timestamp=1768232104 status=200 resp_size=5703
2026-01-12 23:35:05.114 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232104&companyId=8309189&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7408
2026-01-12 23:35:06.487 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/147062300?api_key=51job&timestamp=1768232106 status=200 resp_size=7061
2026-01-12 23:35:06.728 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232106&companyId=2859609&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5470
2026-01-12 23:35:10.969 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170087713?api_key=51job&timestamp=1768232110 status=200 resp_size=6392
2026-01-12 23:35:11.122 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232110&companyId=9026531&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10729
2026-01-12 23:35:13.343 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169961053?api_key=51job&timestamp=1768232113 status=200 resp_size=7172
2026-01-12 23:35:13.503 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232113&companyId=1451330&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7271
2026-01-12 23:35:14.668 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/138538822?api_key=51job&timestamp=1768232114 status=200 resp_size=7607
2026-01-12 23:35:14.830 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232114&companyId=998618&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12022
2026-01-12 23:35:25.539 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/140194322?api_key=51job&timestamp=1768232124 status=200 resp_size=7276
2026-01-12 23:35:25.745 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232125&companyId=6704793&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=2972
2026-01-12 23:35:28.476 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170005961?api_key=51job&timestamp=1768232128 status=200 resp_size=6791
2026-01-12 23:35:28.716 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232128&companyId=6410180&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5579
2026-01-12 23:35:33.487 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170063024?api_key=51job&timestamp=1768232133 status=200 resp_size=6941
2026-01-12 23:35:33.734 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232133&companyId=110741&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6422
2026-01-12 23:35:38.956 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/150106642?api_key=51job&timestamp=1768232138 status=200 resp_size=6561
2026-01-12 23:35:39.162 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232138&companyId=998618&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=12022
2026-01-12 23:35:39.162 | INFO     | __main__:get_recommend_jobs:798 - 准备上报第 14 页数据，包含详细信息的数据条数: 20
2026-01-12 23:35:39.227 | INFO     | __main__:report_data:268 - 数据上报成功: job, 上报条数: 20, 响应大小: 113 字节
2026-01-12 23:35:39.227 | INFO     | __main__:crawl_multiple_pages:1031 - 第 14 页获取到 20 个职位 | 累计: 280 个
2026-01-12 23:35:45.918 | INFO     | __main__:crawl_multiple_pages:1045 - 休眠 6.69 秒后继续...
2026-01-12 23:35:45.918 | INFO     | __main__:crawl_multiple_pages:1005 - 
>>> 正在爬取第 15/26 页...
2026-01-12 23:35:45.919 | INFO     | __main__:_init_client:416 - 初始化客户端，使用代理: http://t13319619426654:ln8aj9nl@s432.kdltps.com:15818
2026-01-12 23:35:45.940 | INFO     | __main__:get_recommend_jobs:659 - 获取推荐职位: 页码=15, 页大小=20, 地区=81400, 工作类型=0565
2026-01-12 23:35:46.691 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:35:47.865 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:35:50.020 | WARNING  | __main__:_make_request:619 - 请求失败: 500 - {"status":"100000","message":"网络超时，请稍后重试！"}
2026-01-12 23:35:50.022 | ERROR    | __main__:_make_request:645 - 所有重试失败，请求终止
2026-01-12 23:35:50.571 | INFO     | __main__:_make_request:616 - 请求参数 method=POST url=https://cupid.51job.com/open/noauth/recommend/job-tab-dynamic-wx-mini?api_key=51job&timestamp=1768232145 status=200 resp_size=172452
2026-01-12 23:35:50.576 | INFO     | __main__:get_recommend_jobs:747 - 第 15 页成功获取 20 个职位（去重后: 20） | API返回totalCount: 501 (原始值: 501) | 地区: 义乌(81400) | 职能: 夹具工程师(0565)
2026-01-12 23:35:50.834 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/142076420?api_key=51job&timestamp=1768232150 status=200 resp_size=6564
2026-01-12 23:35:51.036 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232150&companyId=1253610&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10021
2026-01-12 23:35:54.317 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/156899271?api_key=51job&timestamp=1768232154 status=200 resp_size=6602
2026-01-12 23:35:54.519 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232154&companyId=7439393&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8050
2026-01-12 23:36:03.371 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170231674?api_key=51job&timestamp=1768232162 status=200 resp_size=5777
2026-01-12 23:36:03.559 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232163&companyId=6817482&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9941
2026-01-12 23:36:12.442 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/157642314?api_key=51job&timestamp=1768232171 status=200 resp_size=6297
2026-01-12 23:36:12.623 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232172&companyId=1644420&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7323
2026-01-12 23:36:16.950 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/162634483?api_key=51job&timestamp=1768232176 status=200 resp_size=6145
2026-01-12 23:36:17.145 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232176&companyId=9437588&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=5908
2026-01-12 23:36:28.213 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168950674?api_key=51job&timestamp=1768232186 status=200 resp_size=8774
2026-01-12 23:36:28.495 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232188&companyId=6108855&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=9298
2026-01-12 23:36:37.128 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169998410?api_key=51job&timestamp=1768232196 status=200 resp_size=6727
2026-01-12 23:36:37.376 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232197&companyId=535193&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=14378
2026-01-12 23:36:46.541 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/168947464?api_key=51job&timestamp=1768232205 status=200 resp_size=8682
2026-01-12 23:36:46.747 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232206&companyId=6104559&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8328
2026-01-12 23:36:49.997 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169817474?api_key=51job&timestamp=1768232209 status=200 resp_size=6342
2026-01-12 23:36:50.229 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232209&companyId=2545142&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10393
2026-01-12 23:36:58.840 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170056581?api_key=51job&timestamp=1768232218 status=200 resp_size=7334
2026-01-12 23:36:59.034 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232218&companyId=2456701&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=13581
2026-01-12 23:37:08.465 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/170121028?api_key=51job&timestamp=1768232226 status=200 resp_size=7940
2026-01-12 23:37:08.889 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232228&companyId=2215274&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=8872
2026-01-12 23:37:12.195 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/160067037?api_key=51job&timestamp=1768232231 status=200 resp_size=6531
2026-01-12 23:37:12.570 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232232&companyId=9177738&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=6639
2026-01-12 23:37:14.810 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169821344?api_key=51job&timestamp=1768232233 status=200 resp_size=5922
2026-01-12 23:37:15.781 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232234&companyId=1250754&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=10926
2026-01-12 23:37:18.378 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/122347023?api_key=51job&timestamp=1768232237 status=200 resp_size=4719
2026-01-12 23:37:18.850 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232238&companyId=5872185&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=3093
2026-01-12 23:37:21.893 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/jobs/detail/base/169125590?api_key=51job&timestamp=1768232241 status=200 resp_size=6743
2026-01-12 23:37:22.357 | INFO     | __main__:_make_request:616 - 请求参数 method=GET url=https://cupid.51job.com/open/noauth/company-info/info-data?api_key=51job&timestamp=1768232241&companyId=10008871&colorOne=%23ffffff&colorTwo=%23ffffffcc status=200 resp_size=7743
2026-01-12 23:37:31.285 | INFO     | __main__:crawl_recommend_jobs_main:1223 - 用户中断推荐职位爬取
2026-01-12 23:37:31.289 | INFO     | __main__:close:1137 - httpx客户端已关闭
