Commit Graph

152 Commits

Author SHA1 Message Date
Relakkes 4ea9700db0 docs: 增加赞助名单 2024-03-19 21:50:25 +08:00
relakkes 3a318faee1
Update README.md 2024-03-19 13:27:58 +08:00
Relakkes 5f5147a236 docs: 添加捐赠者名单 2024-03-18 22:55:40 +08:00
Relakkes 8e8f5d41e4 docs: 添加捐赠者名单 2024-03-18 22:03:45 +08:00
relakkes ea66839d72
Update README.md 2024-03-18 13:40:36 +08:00
Relakkes 67443737f5 docs: 添加捐赠者名单 2024-03-17 22:16:58 +08:00
Relakkes 96309dcfee fix: 小红书创作者功能数据获取优化 2024-03-17 14:50:10 +08:00
Relakkes 78a9bf9f38 docs: 添加捐赠者名单 2024-03-17 01:05:10 +08:00
Relakkes 569202af78 feat: update user-agent list 2024-03-17 01:03:56 +08:00
Relakkes 59cd9f67a0 feat: 支持评论模式是否开启爬取选项 2024-03-16 11:52:42 +08:00
Relakkes 2d12ecb930 docs: 增加捐赠名单 2024-03-14 22:06:18 +08:00
Relakkes b48e4d297d docs: 将python3命令修改为python 2024-03-12 23:09:45 +08:00
Relakkes 9e2d1396b8 docs: 增加视频入门教程链接 2024-03-10 03:49:58 +08:00
Relakkes 9ca0a2b717 docs: update README.md 2024-03-09 15:37:51 +08:00
Relakkes 41fee4ff4f feat:小红书支持获取评论中的图片链接 #145 2024-03-07 22:30:44 +08:00
Relakkes 861019022a docs: 增加捐赠者名单 2024-03-05 22:45:32 +08:00
Relakkes 7606c1d993 docs: 增加捐赠者名单 2024-03-05 00:03:51 +08:00
Relakkes 149b6bcdc8 fix: 修复抖音关键词搜索为中文的情况下,有bug 2024-03-03 19:36:36 +08:00
relakkes 7002061d70
Merge pull request #142 from jayeeliu/main
小红书支持通过博主ID采集笔记和评论
2024-03-02 23:30:31 +08:00
jayeeliu@gmail.com 2b1ad18e18 Revert "feat: add aerich for migrate db"
This reverts commit 5f7cd715db.
2024-03-02 23:05:34 +08:00
jayeeliu@gmail.com 5f7cd715db feat: add aerich for migrate db 2024-03-02 15:59:20 +08:00
jayeeliu 9a5460ccca
Merge branch 'NanmiCoder:main' into main 2024-03-02 01:51:02 +08:00
jayeeliu@gmail.com 61ba8c5cc7 feat: 小红书支持通过博主ID采集笔记和评论,小红书type=search时支持配置按哪种排序方式获取笔记数据,小红书笔记增加视频地址和标签字段 2024-03-02 01:49:42 +08:00
Relakkes 384c8f9f7e fix: issue #140 2024-02-26 23:47:02 +08:00
relakkes 67d2b7cff8
Merge pull request #136 from jayeeliu/main
增加sqlite配置示例,解决用sqlite保存数据时,抓取结束不退出的问题
2024-02-22 21:32:19 +08:00
ccgo c09f9fef68 fix: 增加db.close(),解决抓取命令执行完不退出的问题 2024-02-22 00:11:41 +08:00
ccgo 4f5f83d3fa feat: 增加sqlite配置示例 2024-02-22 00:07:40 +08:00
Relakkes 03ca445221 docs: update README.md 2024-02-18 13:06:12 +08:00
Relakkes 192e72588d fix: #123 2024-01-26 23:42:26 +08:00
relakkes f1d3bc6e28
Merge pull request #124 from aa65535/patch-1
修复小红书评论重复插入
2024-01-25 14:33:09 +08:00
Jian Chang 79c0f3bd68
修复小红书评论重复插入 2024-01-25 13:01:04 +08:00
relakkes eb89a6ada8
docs: 添加赞赏者信息 2024-01-21 16:42:37 +08:00
Relakkes e940a41033 refactor: 移除评论中指定数量和过滤特定关键词的逻辑 2024-01-17 23:02:05 +08:00
Relakkes e0f9a487e4 refactor: 代码优化 2024-01-16 00:40:07 +08:00
relakkes e490123fcd
Merge pull request #112 from NanmiCoder/feature/stored_in_json
refactor: 重构数据存储代码,新增jSON
2024-01-14 22:45:00 +08:00
Relakkes 4dfa0d3fbf feat: 数据保存支持JSON格式 2024-01-14 22:40:01 +08:00
Relakkes 894dabcf63 refactor: 数据存储重构,分离不同类型的存储实现 2024-01-14 22:06:31 +08:00
Relakkes e31aebbdfb fix: 修复代理Bug 2024-01-13 15:50:02 +08:00
Relakkes 0240de7324 docs: 添加捐赠信息 2024-01-10 23:59:14 +08:00
Relakkes f85bd0c2b9 docs: 添加捐赠信息 2024-01-07 18:33:08 +08:00
Relakkes 4de14ad6a8 fix: 修复微博PC端登录后COOKIE在手机端无法使用的bug 2024-01-06 19:18:07 +08:00
Relakkes fe073801f8 feat: 小红书增加获取图片地址的方法 2024-01-04 00:11:05 +08:00
Relakkes 80ecc53cd3 fix: #107 2024-01-03 23:08:30 +08:00
Relakkes 38d6f10bf0 feat: 微博二维码登录done 2023-12-30 18:54:21 +08:00
Relakkes 27a2041929 doc: update README.md 2023-12-30 15:16:33 +08:00
Relakkes eee81622ac feat: 微博支持评论 & 指定帖子 2023-12-25 00:02:11 +08:00
Relakkes b1441ab4ae feat: 微博帖子支持保存到数据库中 2023-12-24 18:19:26 +08:00
Relakkes c5b64fdbf5 feat: 微博爬虫帖子搜索完成 2023-12-24 17:57:48 +08:00
Relakkes 9785abba5d docs: update README.md 2023-12-23 01:41:19 +08:00
Relakkes aba9f14f50 refactor: 规范日志打印
feat: B站指定视频ID爬取(bvid)
2023-12-23 01:04:08 +08:00