Commit Graph

152 Commits

Author SHA1 Message Date
Relakkes 95ca606938 feat: 快手文件目录建立 2023-11-23 23:13:54 +08:00
Relakkes 3790e8041e doc: update README.md 2023-11-20 22:07:00 +08:00
Relakkes 81bc8b51e2 feat: 抖音支持指定视频列表爬去 2023-11-18 22:07:30 +08:00
Relakkes 098923d74d refactor: 优化代码-变量名 2023-11-18 15:53:10 +08:00
relakkes ecf9a5e893
Merge pull request #74 from Akiqqqqqqq/bugfix-null-key
fix null key
2023-11-18 15:05:16 +08:00
leonardoqiuyu 4c85355ebd
Merge branch 'main' into bugfix-null-key 2023-11-18 14:59:03 +08:00
Relakkes 700946b28a feat: 小红书增加指定帖子爬取功能
fix: 修复程序一些异常 bug
refactor: 优化部分代码逻辑
2023-11-18 13:38:11 +08:00
Relakkes f24c892471 fix: 修复评论为空导致程序异常退出的 bug 2023-11-18 11:18:54 +08:00
Akiqqqqqqq 602e609115 fix null key 2023-11-14 21:11:18 +08:00
Relakkes cd3a0bdb6a doc: update README.md 2023-11-11 20:49:32 +08:00
relakkes 68c7139dd0
Merge pull request #64 from NanmiCoder/feat/article_url
feat: add article url for issue #63
2023-11-05 15:28:10 +08:00
Relakkes d0ded6689c feat: add article url for issue #63 2023-11-05 15:27:18 +08:00
relakkes 7698c41d51
Merge pull request #40 from yangrq1018/pr
fix: get phone from phone pool when ENABLE_IP_PROXY is False
2023-08-31 08:09:06 -05:00
xiaoniu ad69e63d5f fix: get phone from phone pool when ENABLE_IP_PROXY is False 2023-08-31 14:00:57 +08:00
Relakkes b7fe5b730a style: Change the import order in the code. 2023-08-16 19:56:12 +08:00
Relakkes 9177c38521 feat: 支持数据保存到CSV中 2023-08-16 19:49:41 +08:00
Relakkes c1a3f06c7a fix: issue #32 2023-08-16 13:58:44 +08:00
Relakkes 99812b4669
Merge pull request #32 from renaissancezyc/main
orm添加Pydantic数据验证
2023-08-14 09:32:48 +08:00
zhoubang 1556e1b8cd feat: orm添加Pydantic数据验证 2023-08-13 22:39:50 +08:00
Relakkes 3ae4c5f2f4 fix: issue #23 2023-08-03 22:26:31 +08:00
Relakkes defd8232da
Merge pull request #24 from jayeeliu/main
去掉搜索结果列表中的推荐搜索词(mode_type in ['rec_query', 'hot_query'])
2023-08-01 13:35:00 +08:00
JayeeLiu 925f0a1bc4 去掉搜索结果列表中的推荐搜索词(mode_type in ['rec_query', 'hot_query']) 2023-08-01 10:29:00 +08:00
Relakkes 1d3c2359e0 fix: 修复部分变量命名语义不明确 2023-07-30 21:30:26 +08:00
Relakkes bf659455bb fix: issue #22 2023-07-30 20:43:02 +08:00
Relakkes 4ff2cf8661 refactor: 优化代码 2023-07-29 15:35:40 +08:00
Relakkes febbb133d7 fix: douyin 缺少一个collected_count字段 2023-07-28 21:23:37 +08:00
Relakkes 03565d61c6 fix: issue #19 2023-07-25 20:22:22 +08:00
Relakkes 7d63c2f9ec Merge branch 'main' of github.com:NanmiCoder/MediaCrawler 2023-07-24 21:00:00 +08:00
Relakkes e75707443b feat: 增加配置项支持自由选择数据是否保存到关系型数据库中 2023-07-24 20:59:43 +08:00
Relakkes b94924e21b
Merge pull request #18 from tanpenggood-fork/typo-sam-20230723
typo(field.py): words "normal" typo
2023-07-23 14:30:19 +08:00
tanpenggood ae2de2f792 typo(field.py): words "normal" typo 2023-07-23 13:24:39 +08:00
Nanmi 745e59c875 feat: 完善类型注释,增加 mypy 类型检测 2023-07-16 17:57:18 +08:00
Relakkes e5bdc63323 feat: xhs增加并发控制参数 2023-07-15 22:25:56 +08:00
Relakkes 2398a17e21 refactor: 优化抖音Crawler部分代码
fix: 日志初始化错误修复
2023-07-15 21:30:12 +08:00
Relakkes dad8d56ab5 feat: issue #14
refactor: 优化小红书crawler流程代码
2023-07-15 17:11:53 +08:00
Relakkes e5f4ecd8ec fix: issue #12 2023-07-03 19:34:37 +08:00
Relakkes 0cedd7da40 docs: update readme.md 2023-07-03 12:50:55 +08:00
Relakkes 57437719bf feat: 抖音三种方式登录实现 & 抖音滑块模拟滑动实现 2023-07-01 23:10:47 +08:00
Relakkes 82b7340f19 docs:update README.md 2023-06-28 21:58:36 +08:00
Relakkes 66442b0ff8 fix: 接收短信通知的py应该放到项目根目录下,不然没法导入一些其他Package 2023-06-28 10:16:20 +08:00
Relakkes b8093a2c0f refactor:优化部分代码
feat: 增加IP代理账号池
2023-06-27 23:38:30 +08:00
Relakkes 963d9a16d3 doc: add Star History Chart 2023-06-25 22:01:38 +08:00
Relakkes a7c7f9533d feat: 抖音评论done 2023-06-25 21:09:20 +08:00
Relakkes aefdca6f7c Merge branch 'main' of github.com:NanmiCoder/MediaCrawler 2023-06-22 22:43:51 +08:00
Relakkes 1085a2a769 fix: 增加小红书登录两种形态下弹窗的兼容代码 2023-06-22 22:43:26 +08:00
Nanmi a34b6c13b4 docs: update README 2023-06-18 19:24:22 +08:00
Robt Lenske 88e8ee302e
Merge pull request #4 from wjw136/main
handby&catch exception
2023-06-17 15:33:05 +08:00
ubuntu 79a0296312 handby&catch exception 2023-06-17 15:14:58 +08:00
Relakkes 8206f83639 feat: 小红书增加手机号自动登录模式 2023-06-16 20:10:29 +08:00
Relakkes c0a783fa35 fix: 修复登录二维码扫描不上的bug 2023-06-13 14:09:50 +08:00