MediaCrawler

5681dd6925 fix: #237 Relakkes 2024-04-17 23:32:17 +0800
41fb7bb583 fix: remove kdl secret key Relakkes 2024-04-17 23:19:44 +0800
487afc8e0c refactor: 修改导报顺心 Relakkes 2024-04-17 23:13:40 +0800
d0efd4e4f0 feat: 快代理实现 Relakkes 2024-04-17 23:12:05 +0800
30ae3514c3

Merge pull request #238 from keeper-jie/patch-1 程序员阿江-Relakkes 2024-04-17 21:40:06 +0800
db466fd4d0

Update 常见问题.md Kermit 2024-04-17 11:08:04 +0800
9443e9d28d docs: Update README.md Relakkes 2024-04-14 20:45:49 +0800
87eb8aa6a7 fix: #230 Relakkes 2024-04-13 20:18:04 +0800
c26270146f fix: 修复ip代理池设计bug Relakkes 2024-04-13 18:04:33 +0800
e367129b5f fix: 修复pr#229的小bug Relakkes 2024-04-13 13:48:29 +0800
a341dc2aff

Merge pull request #229 from Tianci-King/main 程序员阿江-Relakkes 2024-04-13 13:37:35 +0800
da949f0c7a

Merge pull request #226 from leantli/feat/sub_comments 程序员阿江-Relakkes 2024-04-13 01:17:55 +0800
6cabece01a chore: remove redundant line breaks leantli 2024-04-12 18:18:01 +0800
ad01dfba95 feat: 轻量化支持爬取小红书二级评论 leantli 2024-04-12 17:32:20 +0800
1115b0d90c feat(core): 新增控制爬虫参数起始页面的页数start_page;perf(argparse): 向命令行解析器添加程序参数起始页面页数和关键字 Tianci-King 2024-04-12 00:52:47 +0800
81a9946afd feat: 支持爬取小红书二级评论 leantli 2024-04-11 17:16:13 +0800
bba9841c26

Merge pull request #223 from Ermeng98/main 程序员阿江-Relakkes 2024-04-11 00:11:04 +0800
9cd6efb916 使用isort对引用进行格式化排序修改微博获取图片默认配置关闭 Er_Meng 2024-04-10 09:54:28 +0800
52c720591f

Merge branch 'NanmiCoder:main' into main Ermeng 2024-04-10 09:51:14 +0800
cab91474ad

Merge pull request #224 from Klu5ure/main 程序员阿江-Relakkes 2024-04-09 23:14:14 +0800
488acd04df fix: #222 Relakkes 2024-04-09 23:10:51 +0800
4ed5d4d73e docs: 恢复文档中误删的字 Klu5ure 2024-04-09 23:00:13 +0800
16413c3074 新增对微博博客内照片获取的支持文件存放路径data/weibo/images Er_Meng 2024-04-09 17:21:52 +0800
5c409c6f0c docs: 群二维码失效，更新 Relakkes 2024-04-08 23:41:53 +0800
8f02da73ad fix: #219 docs: update README.md Relakkes 2024-04-08 00:18:25 +0800
b54f168c6b

Merge pull request #217 from Klu5ure/main 程序员阿江-Relakkes 2024-04-07 23:11:19 +0800
fd7c597305 docs: 修改错别字 Your Name 2024-04-07 22:09:05 +0800
d392747fe7 fix: 移除orm的所有内容 Relakkes 2024-04-06 23:51:03 +0800
1627ae4344

Merge pull request #216 from NanmiCoder/feature/refactor_db 程序员阿江-Relakkes 2024-04-06 22:21:30 +0800
f9cbeb2b14 chore: 移除tortise-orm依赖 Relakkes 2024-04-06 22:14:03 +0800
0c8484c334 feat: db数据存储重构完成 Relakkes 2024-04-06 22:11:10 +0800
de4a437dd7 style: rename image name Relakkes 2024-04-06 12:23:55 +0800
27f3461e31 docs: update README.md Relakkes 2024-04-06 10:57:42 +0800
dde3c0429e refactor: IP代理池重构 Relakkes 2024-04-05 10:44:05 +0800
d0c578c2bf

Merge pull request #213 from Styunlen/patch-1 程序员阿江-Relakkes 2024-04-06 00:51:36 +0800
40daa8d6f3

chore: fix wrong log output when weibo crawler finished Styunlen 2024-04-06 00:41:05 +0800
5495d76fdb

Merge pull request #212 from chunpat/fixbug_qrcode_show 程序员阿江-Relakkes 2024-04-05 22:02:06 +0800
6422500e32 Remove duplication Qrcode Show chunpat 2024-04-05 21:24:06 +0800
87e3d0848a

Merge pull request #209 from xbsheng/chore/text 程序员阿江-Relakkes 2024-04-04 18:11:42 +0800
2d24cf0f44 chore: 修改错别字 xbsheng 2024-04-04 17:32:23 +0800
6160428909

Merge pull request #202 from zhihuiio/patch-1 程序员阿江-Relakkes 2024-04-04 13:12:50 +0800
208978b88f

Merge pull request #206 from leantli/fix/max_notes_count 程序员阿江-Relakkes 2024-04-04 00:46:42 +0800
68a60faa7f chore: 简化判断方式 leantli 2024-04-04 00:11:22 +0800
3de57459c1 docs: 增加交流2群二维码 Relakkes 2024-04-03 13:40:38 +0800
85382ac7ed docs:更新许可证协议，不允许商用。 Relakkes 2024-04-03 12:34:34 +0800
133f978477 fix: 修复爬取视频/帖子最大数设置值较低导致不爬取的问题 leantli 2024-04-03 12:18:23 +0800
e4836847cd docs: update README.md Relakkes 2024-04-01 22:08:26 +0800
085702820a

Update requirements.txt zhihuiio 2024-04-01 20:28:50 +0800
285ab7abe6

Update README.md 程序员阿江-Relakkes 2024-04-01 12:54:53 +0800
bb732ed2ff docs: 增加MediaCrawler视频课程链接 Relakkes 2024-03-31 23:51:37 +0800
6d8c8fb22e feat: add mysql table Relakkes 2024-03-31 15:02:52 +0800
807af1abed

Merge pull request #201 from Schofi/main 程序员阿江-Relakkes 2024-03-31 14:40:11 +0800
e950e0d6e3 feat: add abstract api client to all platform Relakkes 2024-03-30 21:27:25 +0800
67ec49498a refactor: rename xhs to xiaohongshu Relakkes 2024-03-30 21:17:33 +0800
81317482f8

Update README.md Schofi 2024-03-30 18:29:41 +0800
aa257aab51 docs: update README.md Relakkes 2024-03-30 14:14:10 +0800
aca1924bd7

Merge pull request #183 from BaoZhuhan/fix-markdown relakkes 2024-03-19 23:13:34 +0800
1389ad0f81 Merge branch 'fix-markdown' of github.com:BaoZhuhan/MediaCrawler into fix-markdown BaoZhuhan 2024-03-19 22:59:33 +0800
4c20b02273 fix : 修复”常见问题.md“语法问题 BaoZhuhan 2024-03-19 22:54:21 +0800
96caede849

Merge pull request #182 from BaoZhuhan/fix-markdown relakkes 2024-03-19 22:51:45 +0800
d4c8d8dd08 fix : 修复”常见问题.md“ BaoZhuhan 2024-03-19 22:50:28 +0800
1e6470b162 fix ：修复了“常见问题.md” BaoZhuhan 2024-03-19 22:48:39 +0800
13596fc1e4 fix: 修复了“常见问题.md"的语法问题。 BaoZhuhan 2024-03-19 22:37:15 +0800
4ea9700db0 docs: 增加赞助名单 Relakkes 2024-03-19 21:50:25 +0800
3a318faee1

Update README.md relakkes 2024-03-19 13:27:58 +0800
5f5147a236 docs: 添加捐赠者名单 Relakkes 2024-03-18 22:55:40 +0800
8e8f5d41e4 docs: 添加捐赠者名单 Relakkes 2024-03-18 22:03:45 +0800
ea66839d72

Update README.md relakkes 2024-03-18 13:40:36 +0800
67443737f5 docs: 添加捐赠者名单 Relakkes 2024-03-17 22:16:58 +0800
96309dcfee fix: 小红书创作者功能数据获取优化 Relakkes 2024-03-17 14:50:10 +0800
78a9bf9f38 docs: 添加捐赠者名单 Relakkes 2024-03-17 01:05:10 +0800
569202af78 feat: update user-agent list Relakkes 2024-03-17 01:03:56 +0800
59cd9f67a0 feat: 支持评论模式是否开启爬取选项 Relakkes 2024-03-16 11:52:42 +0800
2d12ecb930 docs: 增加捐赠名单 Relakkes 2024-03-14 22:06:18 +0800
b48e4d297d docs: 将python3命令修改为python Relakkes 2024-03-12 23:09:45 +0800
9e2d1396b8 docs: 增加视频入门教程链接 Relakkes 2024-03-10 03:49:58 +0800
9ca0a2b717 docs: update README.md Relakkes 2024-03-09 15:37:51 +0800
41fee4ff4f feat：小红书支持获取评论中的图片链接 #145 Relakkes 2024-03-07 22:30:44 +0800
861019022a docs: 增加捐赠者名单 Relakkes 2024-03-05 22:45:32 +0800
7606c1d993 docs: 增加捐赠者名单 Relakkes 2024-03-05 00:03:51 +0800
149b6bcdc8 fix: 修复抖音关键词搜索为中文的情况下，有bug Relakkes 2024-03-03 19:36:36 +0800
7002061d70

Merge pull request #142 from jayeeliu/main relakkes 2024-03-02 23:30:31 +0800
2b1ad18e18 Revert "feat: add aerich for migrate db" jayeeliu@gmail.com 2024-03-02 23:05:34 +0800
5f7cd715db feat: add aerich for migrate db jayeeliu@gmail.com 2024-03-02 15:58:35 +0800
9a5460ccca

Merge branch 'NanmiCoder:main' into main jayeeliu 2024-03-02 01:51:02 +0800
61ba8c5cc7 feat: 小红书支持通过博主ID采集笔记和评论，小红书type=search时支持配置按哪种排序方式获取笔记数据，小红书笔记增加视频地址和标签字段 jayeeliu@gmail.com 2024-03-02 01:49:42 +0800
384c8f9f7e fix: issue #140 Relakkes 2024-02-26 23:47:02 +0800
67d2b7cff8

Merge pull request #136 from jayeeliu/main relakkes 2024-02-22 21:32:19 +0800
c09f9fef68 fix: 增加db.close()，解决抓取命令执行完不退出的问题 ccgo 2024-02-22 00:11:41 +0800
4f5f83d3fa feat: 增加sqlite配置示例 ccgo 2024-02-22 00:07:40 +0800
03ca445221 docs: update README.md Relakkes 2024-02-18 13:06:12 +0800
192e72588d fix: #123 Relakkes 2024-01-26 23:42:26 +0800
f1d3bc6e28

Merge pull request #124 from aa65535/patch-1 relakkes 2024-01-25 14:33:09 +0800
79c0f3bd68

修复小红书评论重复插入 Jian Chang 2024-01-25 13:01:04 +0800
eb89a6ada8

docs: 添加赞赏者信息 relakkes 2024-01-21 16:42:37 +0800
e940a41033 refactor: 移除评论中指定数量和过滤特定关键词的逻辑 Relakkes 2024-01-17 23:02:05 +0800
e0f9a487e4 refactor: 代码优化 Relakkes 2024-01-16 00:40:07 +0800
e490123fcd

Merge pull request #112 from NanmiCoder/feature/stored_in_json relakkes 2024-01-14 22:45:00 +0800
4dfa0d3fbf feat: 数据保存支持JSON格式 Relakkes 2024-01-14 22:40:01 +0800
894dabcf63 refactor: 数据存储重构，分离不同类型的存储实现 Relakkes 2024-01-14 22:06:31 +0800

Commit Graph Select branches Hide Pull Requests main qnloft_dev_20241119 Mono Color

Commit Graph

Select branches

Hide Pull Requests

main

qnloft_dev_20241119