qnloft
/
MediaCrawler
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
372 Commits 2 Branches 0 Tags 21 MiB
Commit Graph

372 Commits

Author SHA1 Message Date
HIRO fd7407cc29 Merge branch 'kuaishou' 2024-06-13 14:54:01 +08:00
HIRO a001556ba7 快手指定创作者主页和二级评论 2024-06-13 14:49:07 +08:00
程序员阿江-Relakkes d04fc7552f
Merge pull request #298 from Rosyrain/main 
Add third-party libraries and their versions for word cloud generation to the requirements.txt file.
 2024-06-13 12:50:57 +08:00
Rosyrain 78b0d317ff Merge remote-tracking branch 'origin/main' 2024-06-13 12:21:15 +08:00
Rosyrain a24f5279ba 完善生成词云图所需库的安装 2024-06-13 12:20:57 +08:00
xueyueben 576c8e8d9f fix: 修复抖音筛选发布时间和排序失效问题 2024-06-13 11:46:25 +08:00
程序员阿江-Relakkes 2e367a0414
Merge pull request #294 from Rosyrain/main 
Add the functionality to generate word cloud images.
 2024-06-12 21:53:54 +08:00
程序员阿江-Relakkes 131e68334d
Merge branch 'main' into main 2024-06-12 21:53:41 +08:00
程序员阿江-Relakkes 551e00c093
Merge pull request #295 from nelzomal/bili_creator 
feat: support bilibili creator
 2024-06-12 21:44:59 +08:00
程序员阿江-Relakkes f2921b935d
Merge pull request #293 from nelzomal/add_more_arg 
add few more cmd args
 2024-06-12 21:41:19 +08:00
nelzomal 111e08602c feat: support bilibili creator 2024-06-12 16:48:19 +08:00
Rosyrain 7048f040c9 完成词云图生成函数并添加至存储逻辑中 2024-06-12 15:33:39 +08:00
nelzomal 985ea93caf add few arg cmds 2024-06-12 10:53:03 +08:00
Relakkes 645ec729f6 fix: command args need default value 2024-06-11 23:55:42 +08:00
程序员阿江-Relakkes 5a2bae4c2c
Merge pull request #290 from nelzomal/base_config 
improve base config reading command line arg logic
 2024-06-11 21:27:56 +08:00
nelzomal eace7d1750 improve base config reading command line arg logic 2024-06-09 18:51:36 +08:00
Relakkes 3c7c678d7a feat: 抖音db存储增加parent_comment_id 2024-06-07 13:32:58 +08:00
程序员阿江-Relakkes c8dbc0bf3d
Merge pull request #278 from ZuWard/main 
抖音二级评论
 2024-06-07 13:04:18 +08:00
Relakkes 2082e16103 docs: 群二维码过期更新 2024-06-06 22:25:46 +08:00
Relakkes 4bba1447f8 feat: cache impl done 2024-06-02 19:57:13 +08:00
Relakkes 6c4116f240 feat: abstract cache class implementation 2024-06-02 11:16:18 +08:00
Relakkes 93dbc15f0f docs: update README.md 2024-06-01 00:55:09 +08:00
Relakkes a4ceaca4e8 docs: update README.md 2024-06-01 00:51:44 +08:00
程序员阿江-Relakkes fd51a15785
Merge pull request #281 from nelzomal/improve_db_config 
feat: improve db config
 2024-06-01 00:20:05 +08:00
Nan Zhou 94d24a9530 feat: improve db config 2024-05-30 15:35:05 +08:00
ZuWard 0ba68809a5 抖音二级评论 2024-05-29 06:35:37 +08:00
程序员阿江-Relakkes 5e145c31b9
Merge pull request #276 from Zzendrix/main 
fix(weibo): weibo data regular
 2024-05-28 21:37:31 +08:00
Zzzendrix 6409b4fecc fix(weibo): weibo data regular 2024-05-28 15:11:52 +08:00
Relakkes 478db4cc4b feat: 抖音指定创作者done 2024-05-28 01:07:19 +08:00
Relakkes df1e4a7b02 refactor: 抖音登录态检测不在抛出警告，可能会误导使用者 2024-05-27 22:44:35 +08:00
Relakkes 7635ffd9e5 docs: update README.md 2024-05-26 21:25:23 +08:00
程序员阿江-Relakkes 3725128a35
Merge pull request #273 from nelzomal/bili-level-two-comment 
feat: support bilibili level two comment
 2024-05-26 15:34:28 +08:00
Nan Zhou 0cad36e17b support bilibili level two comment 2024-05-26 14:10:57 +08:00
Relakkes 764bafc626 feat: 抖音登录态检测逻辑更新支持 2024-05-23 22:15:14 +08:00
Relakkes 3c4695eed7 docs: update README.md 2024-05-18 17:09:51 +08:00
Relakkes e64df93edd feat: 由于xhs和dy现在检测playwright二维码登录了，大概率会出现滑块或者手机验证，增加登录态检测时间为5min，预留足够的时间手动过验证码。 2024-05-15 23:23:30 +08:00
Relakkes 46f8cc064a feat: 增加爬虫程序运行前的说明 2024-05-13 21:01:54 +08:00
Relakkes 704ee8cf9d docs: update README.md 2024-05-12 23:28:50 +08:00
Relakkes 60182213fa docs: update README.md 2024-05-10 22:42:41 +08:00
程序员阿江-Relakkes 2df6ebe0d4
Merge pull request #265 from leantli/fix/value_error&typo 
fix: 捕捉处理 ValueError 报错以及修改错字
 2024-05-10 22:28:37 +08:00
leantli 43acde240b fix: 捕捉处理 ValueError 报错以及修改错字 2024-05-08 22:26:35 +08:00
Relakkes 57ee8dd63b docs: update README.md 2024-05-03 18:31:18 +08:00
Relakkes 292cceb4a6 docs: update README.md 2024-05-01 16:56:45 +08:00
程序员阿江-Relakkes 411ed2ead9
Merge pull request #253 from kexinoh/main 
新增id，解决同一天内的不同查询写入同一个文件的问题
 2024-04-30 23:10:16 +08:00
KEXNA 9f8ffe1840 Update weibo_store_impl.py 
Update bilibili_store_impl.py

新增id

Update bilibili_store_impl.py

新增id，解决同一天内的不同查询写入同一个文件的问题

Update douyin_store_impl.py

新增id，解决同一天内的不同查询写入同一个文件的问题

Update kuaishou_store_impl.py

Update weibo_store_impl.py

Update xhs_store_impl.py

Update weibo_store_impl.py

Update kuaishou_store_impl.py

Update bilibili_store_impl.py

Update douyin_store_impl.py

Update kuaishou_store_impl.py

Update xhs_store_impl.py
 2024-04-30 21:42:06 +08:00
程序员阿江-Relakkes 237d5be894
Merge pull request #255 from henryhyn/feat/log_config 
feat: 配置日志打印文件及行号
 2024-04-27 13:18:13 +08:00
Henry He 0a95b7d30b feat: 配置日志打印文件及行号 2024-04-27 12:11:42 +08:00
程序员阿江-Relakkes 2d051cc670
Merge pull request #252 from henryhyn/fix/help-f-string 
fix: 修复 f-string 双引号问题
 2024-04-26 23:58:25 +08:00
Henry He a2dca888ac fix: 修复 f-string 双引号问题 2024-04-26 11:02:55 +08:00
程序员阿江-Relakkes abb82076eb
Merge pull request #250 from bigfa/fixed-trace-id 
fix:兼容网页端上传的图片原图获取
 2024-04-25 22:18:40 +08:00