839ed3368e
Some improvements to the lowvram unloading.
2024-11-22 20:59:15 -05:00
bc6be6c11e
Some fixes to the lowvram system.
2024-11-22 16:40:04 -05:00
41444b5236
Add some new weight patching functionality.
...
Add a way to reshape lora weights.
Allow weight patches to all weight not just .weight and .bias
Add a way for a lora to set a weight to a specific value.
2024-11-21 07:19:17 -05:00
f9f9faface
Fixed model merging issue with scaled fp8.
2024-10-20 06:24:31 -04:00
a68bbafddb
Support diffusion models with scaled fp8 weights.
2024-10-19 23:47:42 -04:00
3bb4dec720
Fix issue with loras, lowvram and --fast fp8.
2024-09-28 14:42:32 -04:00
0849c80e2a
get_key_patches now works without unloading the model.
2024-09-17 01:57:59 -04:00
9d720187f1
types -> comfy_types to fix import issue.
2024-09-12 03:57:46 -04:00
2ca8f6e23d
Make the stochastic fp8 rounding reproducible.
2024-08-26 15:12:06 -04:00
c6812947e9
Fix potential memory leak.
2024-08-26 02:07:32 -04:00
7df42b9a23
Fix dora.
2024-08-23 04:58:59 -04:00
c26ca27207
Move calculate function to comfy.lora
2024-08-22 17:12:00 -04:00
7c6bb84016
Code cleanups.
2024-08-22 17:05:12 -04:00
4d341b78e8
Bug fixes.
2024-08-19 16:28:55 -04:00
6138f92084
Use better dtype for the lowvram lora system.
2024-08-19 15:35:25 -04:00
be0726c1ed
Remove duplication.
2024-08-19 15:26:50 -04:00
20ace7c853
Code cleanup.
2024-08-19 12:48:59 -04:00
bb222ceddb
Fix loras having a weak effect when applied on fp8.
2024-08-17 15:20:17 -04:00
cd5017c1c9
calculate_weight function to use a different dtype.
2024-08-17 01:06:08 -04:00
83f343146a
Fix potential lowvram issue.
2024-08-16 17:12:42 -04:00
74e124f4d7
Fix some issues with TE being in lowvram mode.
2024-08-12 23:42:21 -04:00
5d43e75e5b
Fix some issues with the model sometimes not getting patched.
2024-08-12 12:27:54 -04:00
517f4a94e4
Fix some lora loading slowdowns.
2024-08-12 11:50:32 -04:00
52a471c5c7
Change name of log.
2024-08-12 10:35:06 -04:00
1de69fe4d5
Fix some issues with inference slowing down.
2024-08-10 16:21:25 -04:00
6678d5cf65
Fix regression.
2024-08-09 14:02:38 -04:00
a3cc326748
Better fix for lowvram issue.
2024-08-09 12:16:25 -04:00
5acdadc9f3
Fix issue with some lowvram weights.
2024-08-09 03:58:28 -04:00
1e11d2d1f5
Better prints.
2024-08-08 17:29:27 -04:00
08f92d55e9
Partial model shift support.
2024-08-08 14:45:06 -04:00
cb7c4b4be3
Workaround for lora OOM on lowvram mode.
2024-08-07 14:30:54 -04:00
b334605a66
Fix OOMs happening in some cases.
...
A cloned model patcher sometimes reported a model was loaded on a device
when it wasn't.
2024-08-06 13:36:04 -04:00
f1a01c2c7e
Add sampler_pre_cfg_function ( #3979 )
...
* Update samplers.py
* Update model_patcher.py
2024-07-09 16:20:49 -04:00
73ca780019
Add SamplerEulerCFG++ node.
...
This node should match the DDIM implementation of CFG++ when "regular" is
selected.
"alternative" is a slightly different take on CFG++
2024-06-23 13:21:18 -04:00
028a583bef
Fix issue with full diffusers SD3 loras.
2024-06-19 22:32:04 -04:00
0e06b370db
Print key names for easier debugging.
2024-06-14 18:18:53 -04:00
37a08a41b3
Support setting weight offsets in weight patcher.
2024-06-13 17:21:26 -04:00
809cc85a8e
Remove useless code.
2024-06-02 19:23:37 -04:00
ffc4b7c30e
Fix DORA strength.
...
This is a different version of #3298 with more correct behavior.
2024-05-25 02:50:11 -04:00
efa5a711b2
Reduce memory usage when applying DORA: #3557
2024-05-24 23:36:48 -04:00
7718ada4ed
Add type annotation UnetWrapperFunction ( #3531 )
...
* Add type annotation UnetWrapperFunction
* nit
* Add types.py
2024-05-22 02:07:27 -04:00
2d41642716
Fix lowvram dora issue.
2024-05-15 02:47:40 -04:00
fa6dd7e5bb
Fix lowvram issue with saving checkpoints.
...
The previous fix didn't cover the case where the model was loaded in
lowvram mode right before.
2024-05-12 06:13:45 -04:00
e1489ad257
Fix issue with lowvram mode breaking model saving.
2024-05-11 21:55:20 -04:00
719fb2c81d
Add basic PAG node.
2024-04-14 23:49:50 -04:00
38ed2da2dd
Fix typo in lowvram patcher ( #3209 )
2024-04-05 12:02:13 -04:00
41ed7e85ea
Fix object_patches_backup not being the same object across clones.
2024-04-05 00:22:44 -04:00
1f4fc9ea0c
Fix issue with get_model_object on patched model.
2024-04-04 23:01:02 -04:00
1a0486bb96
Fix model needing to be loaded on GPU to generate the sigmas.
2024-04-04 22:08:49 -04:00
ae77590b4e
dora_scale support for lora file.
2024-03-25 18:09:23 -04:00
comfyanonymous
Extraltodeus
Chenlei Hu
kk-89