41444b5236
Add some new weight patching functionality.
...
Add a way to reshape lora weights.
Allow weight patches to all weight not just .weight and .bias
Add a way for a lora to set a weight to a specific value.
2024-11-21 07:19:17 -05:00
af8cf79a2d
support SimpleTuner lycoris lora for SD3 ( #5340 )
2024-10-24 01:18:32 -04:00
f9f9faface
Fixed model merging issue with scaled fp8.
2024-10-20 06:24:31 -04:00
203942c8b2
Fix flux doras with diffusers keys.
2024-10-08 19:03:40 -04:00
b4626ab93e
Add simpletuner lycoris format for SD unet.
2024-09-30 06:03:27 -04:00
70a708d726
Fix model merging issue.
2024-09-20 02:31:44 -04:00
9c5fca75f4
Fix lora issue.
2024-09-08 10:10:47 -04:00
32a60a7bac
Support onetrainer text encoder Flux lora.
2024-09-08 09:31:41 -04:00
ea77750759
Support a generic Comfy format for text encoder loras.
...
This is a format with keys like:
text_encoders.clip_l.transformer.text_model.encoder.layers.9.self_attn.v_proj.lora_up.weight
Instead of waiting for me to add support for specific lora formats you can
convert your text encoder loras to this format instead.
If you want to see an example save a text encoder lora with the SaveLora
node with the commit right after this one.
2024-09-07 02:20:39 -04:00
483004dd1d
Support newer glora format.
2024-09-03 17:02:19 -04:00
d043997d30
Flux onetrainer lora.
2024-09-02 08:22:15 -04:00
6eb5d64522
Fix glora lowvram issue.
2024-08-29 19:07:23 -04:00
6bbdcd28ae
Support weight padding on diff weight patch ( #4576 )
2024-08-27 13:55:37 -04:00
7df42b9a23
Fix dora.
2024-08-23 04:58:59 -04:00
c0b0da264b
Missing imports.
2024-08-22 17:20:51 -04:00
c26ca27207
Move calculate function to comfy.lora
2024-08-22 17:12:00 -04:00
ea63b1c092
Simpletrainer lycoris format.
2024-08-20 12:05:13 -04:00
a9f04edc58
Implement text encoder part of HunyuanDiT loras.
2024-08-09 03:21:10 -04:00
1208863eca
Fix "Comfy" lora keys.
...
They are in this format now:
diffusion_model.full.model.key.name.lora_up.weight
2024-08-07 13:49:31 -04:00
17030fd4c0
Support for "Comfy" lora format.
...
The keys are just: model.full.model.key.name.lora_up.weight
It is supported by all comfyui supported models.
Now people can just convert loras to this format instead of having to ask
for me to implement them.
2024-08-07 13:18:32 -04:00
78e133d041
Support simple diffusers Flux loras.
2024-08-04 22:05:48 -04:00
25b51b1a8b
Hunyuan DiT lora support.
2024-07-25 22:42:54 -04:00
a3dffc447a
Support AuraFlow Lora and loading model weights in diffusers format.
...
You can load model weights in diffusers format using the UNETLoader node.
2024-07-13 13:51:40 -04:00
2f360ae898
Support OneTrainer SD3 lora format.
2024-06-22 13:08:04 -04:00
3914d5a2ae
Support full SD3 loras.
2024-06-19 10:13:33 -04:00
b7c473d1ab
Fix lora keys for SimpleTuner ( #3759 )
2024-06-17 07:55:06 -04:00
ac151ac169
Support SD3 diffusers lora.
2024-06-13 18:26:10 -04:00
ae77590b4e
dora_scale support for lora file.
2024-03-25 18:09:23 -04:00
65397ce601
Replace prints with logging and add --verbose argument.
2024-03-10 12:14:23 -04:00
c2cb8e889b
Always return unprojected pooled output for gligen.
2024-02-25 07:33:13 -05:00
6533b172c1
Support text encoder text_projection in lora.
2024-02-24 23:50:46 -05:00
1e5f0f66be
Support lora keys with lora_prior_unet_ and lora_prior_te_
2024-02-23 12:21:20 -05:00
614b7e731f
Implement GLora.
2023-12-09 18:15:26 -05:00
cb63e230b4
Make lora code a bit cleaner.
2023-12-09 14:15:09 -05:00
ec12000136
Add support for full diff lora keys.
2023-11-08 22:05:31 -05:00
e60ca6929a
SD1 and SD2 clip and tokenizer code is now more similar to the SDXL one.
2023-10-27 15:54:04 -04:00
4798cf5a62
Implement loras with norm keys.
2023-08-28 11:20:06 -04:00
15a7716fa6
Move lora code to comfy/lora.py
2023-08-25 17:11:51 -04:00
comfyanonymous
PsychoLogicAu
Chenlei Hu
Janek Mann