qnloft
/
MediaCrawler
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Commit Graph

  • e31aebbdfb fix: 修复代理Bug Relakkes 2024-01-13 15:50:02 +0800
  • 0240de7324 docs: 添加捐赠信息 Relakkes 2024-01-10 23:59:14 +0800
  • f85bd0c2b9 docs: 添加捐赠信息 Relakkes 2024-01-07 18:33:08 +0800
  • 4de14ad6a8 fix: 修复微博PC端登录后COOKIE在手机端无法使用的bug Relakkes 2024-01-06 19:18:07 +0800
  • fe073801f8 feat: 小红书增加获取图片地址的方法 Relakkes 2024-01-04 00:11:05 +0800
  • 80ecc53cd3 fix: #107 Relakkes 2024-01-03 23:08:30 +0800
  • 38d6f10bf0 feat: 微博二维码登录done Relakkes 2023-12-30 18:54:21 +0800
  • 27a2041929 doc: update README.md Relakkes 2023-12-30 15:16:33 +0800
  • eee81622ac feat: 微博支持评论 & 指定帖子 Relakkes 2023-12-25 00:02:11 +0800
  • b1441ab4ae feat: 微博帖子支持保存到数据库中 Relakkes 2023-12-24 18:19:26 +0800
  • c5b64fdbf5 feat: 微博爬虫帖子搜索完成 Relakkes 2023-12-24 17:57:48 +0800
  • 9785abba5d docs: update README.md Relakkes 2023-12-23 01:41:19 +0800
  • aba9f14f50 refactor: 规范日志打印 feat: B站指定视频ID爬取（bvid） Relakkes 2023-12-23 01:04:08 +0800
  • 273c9a316b fix: 修复日志打印时参数格式错误 Relakkes 2023-12-22 23:10:44 +0800
  • bced7f6802 doc: update README.md Relakkes 2023-12-22 23:04:08 +0800
  • 2e032d09dc refactor: xhs add log Relakkes 2023-12-19 23:05:12 +0800
  • e2aaf0e5c1 doc: update README.md Relakkes 2023-12-17 18:57:43 +0800
  • f85fd97d25 fix: #10 Relakkes 2023-12-16 00:12:20 +0800
  • 40cbd9f4d7
         Merge pull request #96 from PeanutSplash/main relakkes 2023-12-14 00:57:17 +0800
  • 5c6a636352 fix-bug:修复抖音评论筛选 peanutsplash 2023-12-14 00:55:06 +0800
  • c4d68f868a
         Merge pull request #94 from PeanutSplash/main relakkes 2023-12-14 00:01:44 +0800
  • f17a85305e 添加功能:(哔哩哔哩,快手,小红书)每个视频/帖子抓取评论最大条数限制,评论关键词筛选 peanutsplash 2023-12-13 23:53:12 +0800
  • 5c42076ff8 doc: update README.md Relakkes 2023-12-09 23:50:33 +0800
  • 05016305e8 doc: update README.md Relakkes 2023-12-09 23:49:19 +0800
  • 97d7a0c38b feat: Bilibili comment done Relakkes 2023-12-09 21:10:01 +0800
  • a136ea2739 refactor: delete account_config.py Relakkes 2023-12-09 13:56:18 +0800
  • 2d0f12f058 doc: fixed pydantic version Relakkes 2023-12-09 13:31:53 +0800
  • fd640f2008 doc: update README.md Relakkes 2023-12-09 00:30:31 +0800
  • d37d5ccd12 doc: add SPONSORED BY text Relakkes 2023-12-09 00:28:29 +0800
  • 385662a7b6 doc: 新增代理IP使用文档 Relakkes 2023-12-09 00:06:57 +0800
  • a40a91d7f7 doc: update README.md Relakkes 2023-12-08 00:27:59 +0800
  • 72a68fbf1e doc:将文档拆出去 Relakkes 2023-12-08 00:25:06 +0800
  • 1cec23f73d feat: 代理IP功能 Done Relakkes 2023-12-08 00:10:04 +0800
  • c530bd4219 feat: 代理IP缓存到redis中 Relakkes 2023-12-06 23:49:56 +0800
  • f71d086464 fix: B站get_wbi_keys函数类型标注问题 Relakkes 2023-12-05 23:32:35 +0800
  • a6e877de42 fix: 修复B站搜索Field命名 bug refactor: ping接口统一更换为pong Relakkes 2023-12-05 22:47:36 +0800
  • 6ae511bb52
         Merge pull request #89 from PeanutSplash/main relakkes 2023-12-05 12:42:32 +0800
  • ab1a10bac1 添加功能:抖音每个视频抓取评论最大条数限制,抖音评论关键词筛选 peanutsplash 2023-12-05 11:21:47 +0800
  • 8f04943105 feat: B站评论API Relakkes 2023-12-04 23:16:02 +0800
  • a790d72db9 fix: 修复小红书笔记获取时，不存在的笔记异常问题 Relakkes 2023-12-04 21:54:12 +0800
  • 519165ceec doc: 修改项目代码结构tree Relakkes 2023-12-04 00:11:01 +0800
  • 94b5030ef0 feat: B站二维码、Cookie登录实现 Relakkes 2023-12-04 00:02:00 +0800
  • a90b411e68 feat: B站爬虫搜索关键词实现 Relakkes 2023-12-03 23:19:02 +0800
  • 5aeee93fc5 feat: B站爬虫签名实现 Relakkes 2023-12-03 00:30:10 +0800
  • 5c920da288 feat: 快手二维码登录 Relakkes 2023-12-02 18:22:55 +0800
  • 986179b9c9 feat: 增加 IP 代理的最新实现 Relakkes 2023-12-02 16:14:36 +0800
  • a8a4d34d2a doc: update README.md Relakkes 2023-12-02 10:56:13 +0800
  • e7f68dd7e1 doc: 提供仓库功能列表表格 Relakkes 2023-12-01 23:58:35 +0800
  • 5affc8a600
         Update README.md relakkes 2023-12-01 09:55:38 +0800
  • 6d743552f2 doc: update README.md Relakkes 2023-11-30 23:59:02 +0800
  • 33721e5fbd feat: 快手支持指定视频列表爬取 Relakkes 2023-11-27 23:07:04 +0800
  • 62534d7ee2 fix: 移出快手 client 多余的代码 Relakkes 2023-11-26 22:11:06 +0800
  • 609c3f0673 fix: 修复抖音数据库保存错误 Relakkes 2023-11-26 22:06:26 +0800
  • d59113668f doc: 增加快手爬虫的描述 Relakkes 2023-11-26 21:50:08 +0800
  • 9faa4f4eec
         Merge pull request #82 from NanmiCoder/feat/kuaishou_support relakkes 2023-11-26 21:44:36 +0800
  • dfb1788141 feat: 快手视频评论爬取done；数据保存到DB、CSV done Relakkes 2023-11-26 21:43:39 +0800
  • 2f8541a351 Merge branch 'main' into feat/kuaishou_support Relakkes 2023-11-26 15:44:26 +0800
  • 523c5f380e doc: add command usage Relakkes 2023-11-26 15:38:38 +0800
  • bdf36ccb09 feat: 快手关键词搜索存储CSV完成 Relakkes 2023-11-26 01:05:52 +0800
  • 253888980c doc: 增加如何更换账号的问题 Relakkes 2023-11-25 12:32:43 +0800
  • 512192a93e feat: 搜索接口调试完成 Relakkes 2023-11-25 00:02:33 +0800
  • f08b2ceb76 feat: 1、命令行支持快手 2、快手playwright 代码 done Relakkes 2023-11-24 00:04:33 +0800
  • 6908da6f70 fix: 修复小红书client中get请求中文bug Relakkes 2023-11-23 23:27:35 +0800
  • 95ca606938 feat: 快手文件目录建立 Relakkes 2023-11-23 23:13:54 +0800
  • 3790e8041e doc: update README.md Relakkes 2023-11-20 22:07:00 +0800
  • 81bc8b51e2 feat: 抖音支持指定视频列表爬去 Relakkes 2023-11-18 22:07:30 +0800
  • 098923d74d refactor: 优化代码-变量名 Relakkes 2023-11-18 15:53:10 +0800
  • ecf9a5e893
         Merge pull request #74 from Akiqqqqqqq/bugfix-null-key relakkes 2023-11-18 15:05:16 +0800
  • 4c85355ebd
         Merge branch 'main' into bugfix-null-key leonardoqiuyu 2023-11-18 14:59:03 +0800
  • 700946b28a feat: 小红书增加指定帖子爬取功能 fix: 修复程序一些异常 bug refactor: 优化部分代码逻辑 Relakkes 2023-11-18 13:38:11 +0800
  • f24c892471 fix: 修复评论为空导致程序异常退出的 bug Relakkes 2023-11-18 11:18:54 +0800
  • 602e609115 fix null key Akiqqqqqqq 2023-11-14 21:11:18 +0800
  • cd3a0bdb6a doc: update README.md Relakkes 2023-11-11 20:49:32 +0800
  • 68c7139dd0
         Merge pull request #64 from NanmiCoder/feat/article_url relakkes 2023-11-05 15:28:10 +0800
  • d0ded6689c feat: add article url for issue #63 Relakkes 2023-11-05 15:27:18 +0800
  • 7698c41d51
         Merge pull request #40 from yangrq1018/pr relakkes 2023-08-31 08:09:06 -0500
  • ad69e63d5f fix: get phone from phone pool when ENABLE_IP_PROXY is False xiaoniu 2023-08-31 13:57:54 +0800
  • b7fe5b730a style: Change the import order in the code. Relakkes 2023-08-16 19:56:12 +0800
  • 9177c38521 feat: 支持数据保存到CSV中 Relakkes 2023-08-16 19:49:41 +0800
  • c1a3f06c7a fix: issue #32 Relakkes 2023-08-16 13:58:44 +0800
  • 99812b4669
         Merge pull request #32 from renaissancezyc/main Relakkes 2023-08-14 09:32:48 +0800
  • 1556e1b8cd ✨ feat: orm添加Pydantic数据验证 zhoubang 2023-08-13 22:39:50 +0800
  • 3ae4c5f2f4 fix: issue #23 Relakkes 2023-08-03 22:26:31 +0800
  • defd8232da
         Merge pull request #24 from jayeeliu/main Relakkes 2023-08-01 13:35:00 +0800
  • 925f0a1bc4 去掉搜索结果列表中的推荐搜索词（mode_type in ['rec_query', 'hot_query']） JayeeLiu 2023-08-01 10:29:00 +0800
  • 1d3c2359e0 fix: 修复部分变量命名语义不明确 Relakkes 2023-07-30 21:30:26 +0800
  • bf659455bb fix: issue #22 Relakkes 2023-07-30 20:43:02 +0800
  • 4ff2cf8661 refactor: 优化代码 Relakkes 2023-07-29 15:35:40 +0800
  • febbb133d7 fix: douyin 缺少一个collected_count字段 Relakkes 2023-07-28 21:23:37 +0800
  • 03565d61c6 fix: issue #19 Relakkes 2023-07-25 20:22:22 +0800
  • 7d63c2f9ec Merge branch 'main' of github.com:NanmiCoder/MediaCrawler Relakkes 2023-07-24 21:00:00 +0800
  • e75707443b feat: 增加配置项支持自由选择数据是否保存到关系型数据库中 Relakkes 2023-07-24 20:59:43 +0800
  • b94924e21b
         Merge pull request #18 from tanpenggood-fork/typo-sam-20230723 Relakkes 2023-07-23 14:30:19 +0800
  • ae2de2f792 typo(field.py): words "normal" typo tanpenggood 2023-07-23 13:24:39 +0800
  • 745e59c875 feat: 完善类型注释，增加 mypy 类型检测 Nanmi 2023-07-16 17:57:18 +0800
  • e5bdc63323 feat: xhs增加并发控制参数 Relakkes 2023-07-15 22:25:56 +0800
  • 2398a17e21 refactor: 优化抖音Crawler部分代码 fix: 日志初始化错误修复 Relakkes 2023-07-15 21:30:12 +0800
  • dad8d56ab5 feat: issue #14 refactor: 优化小红书crawler流程代码 Relakkes 2023-07-15 17:11:53 +0800
  • e5f4ecd8ec fix: issue #12 Relakkes 2023-07-03 19:34:37 +0800
  • 0cedd7da40 docs: update readme.md Relakkes 2023-07-03 12:50:55 +0800