comfyanonymous
|
6138f92084
|
Use better dtype for the lowvram lora system.
|
2024-08-19 15:35:25 -04:00 |
|
comfyanonymous
|
be0726c1ed
|
Remove duplication.
|
2024-08-19 15:26:50 -04:00 |
|
comfyanonymous
|
20ace7c853
|
Code cleanup.
|
2024-08-19 12:48:59 -04:00 |
|
comfyanonymous
|
bb222ceddb
|
Fix loras having a weak effect when applied on fp8.
|
2024-08-17 15:20:17 -04:00 |
|
comfyanonymous
|
cd5017c1c9
|
calculate_weight function to use a different dtype.
|
2024-08-17 01:06:08 -04:00 |
|
comfyanonymous
|
83f343146a
|
Fix potential lowvram issue.
|
2024-08-16 17:12:42 -04:00 |
|
comfyanonymous
|
74e124f4d7
|
Fix some issues with TE being in lowvram mode.
|
2024-08-12 23:42:21 -04:00 |
|
comfyanonymous
|
5d43e75e5b
|
Fix some issues with the model sometimes not getting patched.
|
2024-08-12 12:27:54 -04:00 |
|
comfyanonymous
|
517f4a94e4
|
Fix some lora loading slowdowns.
|
2024-08-12 11:50:32 -04:00 |
|
comfyanonymous
|
52a471c5c7
|
Change name of log.
|
2024-08-12 10:35:06 -04:00 |
|
comfyanonymous
|
1de69fe4d5
|
Fix some issues with inference slowing down.
|
2024-08-10 16:21:25 -04:00 |
|
comfyanonymous
|
6678d5cf65
|
Fix regression.
|
2024-08-09 14:02:38 -04:00 |
|
comfyanonymous
|
a3cc326748
|
Better fix for lowvram issue.
|
2024-08-09 12:16:25 -04:00 |
|
comfyanonymous
|
5acdadc9f3
|
Fix issue with some lowvram weights.
|
2024-08-09 03:58:28 -04:00 |
|
comfyanonymous
|
1e11d2d1f5
|
Better prints.
|
2024-08-08 17:29:27 -04:00 |
|
comfyanonymous
|
08f92d55e9
|
Partial model shift support.
|
2024-08-08 14:45:06 -04:00 |
|
comfyanonymous
|
cb7c4b4be3
|
Workaround for lora OOM on lowvram mode.
|
2024-08-07 14:30:54 -04:00 |
|
comfyanonymous
|
b334605a66
|
Fix OOMs happening in some cases.
A cloned model patcher sometimes reported a model was loaded on a device
when it wasn't.
|
2024-08-06 13:36:04 -04:00 |
Extraltodeus
|
f1a01c2c7e
|
Add sampler_pre_cfg_function (#3979)
* Update samplers.py
* Update model_patcher.py
|
2024-07-09 16:20:49 -04:00 |
|
comfyanonymous
|
73ca780019
|
Add SamplerEulerCFG++ node.
This node should match the DDIM implementation of CFG++ when "regular" is
selected.
"alternative" is a slightly different take on CFG++
|
2024-06-23 13:21:18 -04:00 |
|
comfyanonymous
|
028a583bef
|
Fix issue with full diffusers SD3 loras.
|
2024-06-19 22:32:04 -04:00 |
|
comfyanonymous
|
0e06b370db
|
Print key names for easier debugging.
|
2024-06-14 18:18:53 -04:00 |
|
comfyanonymous
|
37a08a41b3
|
Support setting weight offsets in weight patcher.
|
2024-06-13 17:21:26 -04:00 |
|
comfyanonymous
|
809cc85a8e
|
Remove useless code.
|
2024-06-02 19:23:37 -04:00 |
|
comfyanonymous
|
ffc4b7c30e
|
Fix DORA strength.
This is a different version of #3298 with more correct behavior.
|
2024-05-25 02:50:11 -04:00 |
|
comfyanonymous
|
efa5a711b2
|
Reduce memory usage when applying DORA: #3557
|
2024-05-24 23:36:48 -04:00 |
Chenlei Hu
|
7718ada4ed
|
Add type annotation UnetWrapperFunction (#3531)
* Add type annotation UnetWrapperFunction
* nit
* Add types.py
|
2024-05-22 02:07:27 -04:00 |
|
comfyanonymous
|
2d41642716
|
Fix lowvram dora issue.
|
2024-05-15 02:47:40 -04:00 |
|
comfyanonymous
|
fa6dd7e5bb
|
Fix lowvram issue with saving checkpoints.
The previous fix didn't cover the case where the model was loaded in
lowvram mode right before.
|
2024-05-12 06:13:45 -04:00 |
|
comfyanonymous
|
e1489ad257
|
Fix issue with lowvram mode breaking model saving.
|
2024-05-11 21:55:20 -04:00 |
|
comfyanonymous
|
719fb2c81d
|
Add basic PAG node.
|
2024-04-14 23:49:50 -04:00 |
kk-89
|
38ed2da2dd
|
Fix typo in lowvram patcher (#3209)
|
2024-04-05 12:02:13 -04:00 |
|
comfyanonymous
|
41ed7e85ea
|
Fix object_patches_backup not being the same object across clones.
|
2024-04-05 00:22:44 -04:00 |
|
comfyanonymous
|
1f4fc9ea0c
|
Fix issue with get_model_object on patched model.
|
2024-04-04 23:01:02 -04:00 |
|
comfyanonymous
|
1a0486bb96
|
Fix model needing to be loaded on GPU to generate the sigmas.
|
2024-04-04 22:08:49 -04:00 |
|
comfyanonymous
|
ae77590b4e
|
dora_scale support for lora file.
|
2024-03-25 18:09:23 -04:00 |
|
comfyanonymous
|
c18a203a8a
|
Don't unload model weights for non weight patches.
|
2024-03-20 02:27:58 -04:00 |
|
comfyanonymous
|
db8b59ecff
|
Lower memory usage for loras in lowvram mode at the cost of perf.
|
2024-03-13 20:07:27 -04:00 |
|
comfyanonymous
|
65397ce601
|
Replace prints with logging and add --verbose argument.
|
2024-03-10 12:14:23 -04:00 |
|
comfyanonymous
|
12c1080ebc
|
Simplify differential diffusion code.
|
2024-03-03 15:34:42 -05:00 |
|
comfyanonymous
|
1abf8374ec
|
utils.set_attr can now be used to set any attribute.
The old set_attr has been renamed to set_attr_param.
|
2024-03-02 17:27:23 -05:00 |
|
comfyanonymous
|
9f71e4b62d
|
Let model patches patch sub objects.
|
2024-03-02 11:43:27 -05:00 |
|
comfyanonymous
|
ef4f6037cb
|
Fix model patches not working in custom sampling scheduler nodes.
|
2024-01-03 12:16:30 -05:00 |
|
comfyanonymous
|
12e822c6c8
|
Use function to calculate model size in model patcher.
|
2023-12-28 21:46:20 -05:00 |
|
comfyanonymous
|
571ea8cdcc
|
Fix SAG not working with cfg 1.0
|
2023-12-18 17:03:32 -05:00 |
|
comfyanonymous
|
ba04a87d10
|
Refactor and improve the sag node.
Moved all the sag related code to comfy_extras/nodes_sag.py
|
2023-12-13 16:11:26 -05:00 |
|
comfyanonymous
|
614b7e731f
|
Implement GLora.
|
2023-12-09 18:15:26 -05:00 |
|
comfyanonymous
|
cb63e230b4
|
Make lora code a bit cleaner.
|
2023-12-09 14:15:09 -05:00 |
|
comfyanonymous
|
7e3fe3ad28
|
Make deep shrink behave like it should.
|
2023-11-16 15:26:28 -05:00 |
|
comfyanonymous
|
9f00a18095
|
Fix potential issues.
|
2023-11-16 14:59:54 -05:00 |
|
comfyanonymous
|
94cc718e9c
|
Add a way to add patches to the input block.
|
2023-11-14 00:08:12 -05:00 |
|
comfyanonymous
|
dd4ba68b6e
|
Allow different models to estimate memory usage differently.
|
2023-11-12 04:03:52 -05:00 |
|
comfyanonymous
|
248aa3e563
|
Fix bug.
|
2023-11-11 12:20:16 -05:00 |
|
comfyanonymous
|
4a8a839b40
|
Add option to use in place weight updating in ModelPatcher.
|
2023-11-11 01:11:12 -05:00 |
|
comfyanonymous
|
3e0033ef30
|
Fix model merge bug.
Unload models before getting weights for model patching.
|
2023-11-10 03:19:05 -05:00 |
|
comfyanonymous
|
fe40109b57
|
Fix issue with object patches not being copied with patcher.
|
2023-11-07 22:15:15 -05:00 |
|
comfyanonymous
|
844dbf97a7
|
Add: advanced->model->ModelSamplingDiscrete node.
This allows changing the sampling parameters of the model (eps or vpred)
or set the model to use zsnr.
|
2023-11-07 03:28:53 -05:00 |
gameltb
|
7e455adc07
|
fix unet_wrapper_function name in ModelPatcher
|
2023-11-05 17:11:44 +08:00 |
|
comfyanonymous
|
8cc75c64ff
|
Let unet wrapper functions have .to attributes.
|
2023-10-11 01:34:38 -04:00 |
|
comfyanonymous
|
afa2399f79
|
Add a way to set output block patches to modify the h and hsp.
|
2023-09-22 20:26:47 -04:00 |
|
comfyanonymous
|
1cdfb3dba4
|
Only do the cast on the device if the device supports it.
|
2023-09-20 17:52:41 -04:00 |
|
comfyanonymous
|
b92bf8196e
|
Do lora cast on GPU instead of CPU for higher performance.
|
2023-09-18 23:04:49 -04:00 |
Simon Lui
|
18617967e5
|
Fix error message in model_patcher.py
Found while tinkering.
|
2023-08-30 00:25:04 -07:00 |
|
comfyanonymous
|
f92074b84f
|
Move ModelPatcher to model_patcher.py
|
2023-08-28 14:51:31 -04:00 |