2a09e2aa27
refactor/split various bits of code for sampling
2023-04-23 20:02:08 +02:00
5282f56434
Implement Linear hypernetworks.
...
Add a HypernetworkLoader node to use hypernetworks.
2023-04-23 12:35:25 -04:00
6908f9c949
This makes pytorch2.0 attention perform a bit faster.
2023-04-22 14:30:39 -04:00
907010e082
Remove some useless code.
2023-04-20 23:58:25 -04:00
96b57a9ad6
Don't pass adm to model when it doesn't support it.
2023-04-19 21:11:38 -04:00
3696d1699a
Add support for GLIGEN textbox model.
2023-04-19 11:06:32 -04:00
884ea653c8
Add a way for nodes to set a custom CFG function.
2023-04-17 11:05:15 -04:00
73c3e11e83
Fix model_management import so it doesn't get executed twice.
2023-04-15 19:04:33 -04:00
81d1f00df3
Some refactoring: from_tokens -> encode_from_tokens
2023-04-15 18:46:58 -04:00
719c26c3c9
Merge branch 'master' of https://github.com/BlenderNeko/ComfyUI
2023-04-15 14:16:50 -04:00
d0b1b6c6bf
fixed improper padding
2023-04-15 19:38:21 +02:00
deb2b93e79
Move code to empty gpu cache to model_management.py
2023-04-15 11:19:07 -04:00
04d9bc13af
Safely load pickled embeds that don't load with weights_only=True.
2023-04-14 15:33:43 -04:00
da115bd78d
ensure backwards compat with optional args
2023-04-14 21:16:55 +02:00
752f7a162b
align behavior with old tokenize function
2023-04-14 21:02:45 +02:00
334aab05e5
Don't stop workflow if loading embedding fails.
2023-04-14 13:54:00 -04:00
73175cf58c
split tokenizer from encoder
2023-04-13 22:06:50 +02:00
8489cba140
add unique ID per word/embedding for tokenizer
2023-04-13 22:01:01 +02:00
92eca60ec9
Fix for new transformers version.
2023-04-09 15:55:21 -04:00
1e1875f674
Print xformers version and warning about 0.0.18
2023-04-09 01:31:47 -04:00
7e254d2f69
Clarify what --windows-standalone-build does.
2023-04-07 15:52:56 -04:00
44fea05064
Cleanup.
2023-04-07 02:31:46 -04:00
58ed0f2da4
Fix loading SD1.5 diffusers checkpoint.
2023-04-07 01:30:33 -04:00
8b9ac8fedb
Merge branch 'master' of https://github.com/sALTaccount/ComfyUI
2023-04-07 01:03:43 -04:00
64557d6781
Add a --force-fp32 argument to force fp32 for debugging.
2023-04-07 00:27:54 -04:00
bceccca0e5
Small refactor.
2023-04-06 23:53:54 -04:00
28a7205739
Merge branch 'ipex' of https://github.com/kwaa/ComfyUI-IPEX
2023-04-06 23:45:29 -04:00
05eeaa2de5
Merge branch 'master' into ipex
2023-04-07 09:11:30 +08:00
28fff5d1db
fixes lack of support for multi configs
...
also adds some metavars to argarse
2023-04-06 19:06:39 -04:00
f84f2508cc
Rename the cors parameter to something more verbose.
2023-04-06 15:24:55 -04:00
48efae1608
makes cors a cli parameter
2023-04-06 15:06:22 -04:00
01c1fc669f
set listen flag to listen on all if specifed
2023-04-06 13:19:00 -04:00
3e2608e12b
Fix auto lowvram detection on CUDA
2023-04-06 15:44:05 +08:00
60127a8304
diffusers loader
2023-04-05 23:57:31 -07:00
7cb924f684
Use separate variables instead of `vram_state`
2023-04-06 14:24:47 +08:00
84b9c0ac2f
Import intel_extension_for_pytorch as ipex
2023-04-06 12:27:22 +08:00
e5e587b1c0
seperates out arg parser and imports args
2023-04-05 23:41:23 -04:00
37713e3b0a
Add basic XPU device support
...
closed #387
2023-04-05 21:22:14 +08:00
e46b1c3034
Disable xformers in VAE when xformers == 0.0.18
2023-04-04 22:22:02 -04:00
1718730e80
Ignore embeddings when sizes don't match and print a WARNING.
2023-04-04 11:49:29 -04:00
23524ad8c5
Remove print.
2023-04-03 22:58:54 -04:00
539ff487a8
Pull latest tomesd code from upstream.
2023-04-03 15:49:28 -04:00
f50b1fec69
Add noise augmentation setting to unCLIPConditioning.
2023-04-03 13:50:29 -04:00
809bcc8ceb
Add support for unCLIP SD2.x models.
...
See _for_testing/unclip in the UI for the new nodes.
unCLIPCheckpointLoader is used to load them.
unCLIPConditioning is used to add the image cond and takes as input a
CLIPVisionEncode output which has been moved to the conditioning section.
2023-04-01 23:19:15 -04:00
0d972b85e6
This seems to give better quality in tome.
2023-03-31 18:36:18 -04:00
18a6c1db33
Add a TomePatchModel node to the _for_testing section.
...
Tome increases sampling speed at the expense of quality.
2023-03-31 17:19:58 -04:00
61ec3c9d5d
Add a way to pass options to the transformers blocks.
2023-03-31 13:04:39 -04:00
afd65d3819
Fix noise mask not working with > 1 batch size on ksamplers.
2023-03-30 03:50:12 -04:00
b2554bc4dd
Split VAE decode batches depending on free memory.
2023-03-29 02:24:37 -04:00
0d65cb17b7
Fix ddim_uniform crashing with 37 steps.
2023-03-28 16:29:35 -04:00
f55755f0d2
code cleanup
2023-03-27 06:48:09 +02:00
cf0098d539
no lowvram state if cpu only
2023-03-27 04:51:18 +02:00
f5365c9c81
Fix ddim for Mac: #264
2023-03-26 00:36:54 -04:00
4adcea7228
I don't think controlnets were being handled correctly by MPS.
2023-03-24 14:33:16 -04:00
3c6ff8821c
Merge branch 'master' of https://github.com/GaidamakUA/ComfyUI
2023-03-24 13:56:43 -04:00
fc71e7ea08
Fixed typo
2023-03-24 19:39:55 +02:00
7f0fd99b5d
Make ddim work with --cpu
2023-03-24 11:39:51 -04:00
4b943d2b60
Removed unnecessary comment
2023-03-24 14:15:30 +02:00
89fd5ed574
Added MPS device support
2023-03-24 14:12:56 +02:00
dd095efc2c
Support loha that use cp decomposition.
2023-03-23 04:32:25 -04:00
94a7c895f4
Add loha support.
2023-03-23 03:40:12 -04:00
3ed4a4e4e6
Try again with vae tiled decoding if regular fails because of OOM.
2023-03-22 14:49:00 -04:00
4039616ca6
Less seams in tiled outputs at the cost of more processing.
2023-03-22 03:29:09 -04:00
c692509c2b
Try to improve VAEEncode memory usage a bit.
2023-03-22 02:45:18 -04:00
9d0665c8d0
Add laptop quadro cards to fp32 list.
2023-03-21 16:57:35 -04:00
cc309568e1
Add support for locon mid weights.
2023-03-21 14:51:51 -04:00
edfc4ca663
Try to fix a vram issue with controlnets.
2023-03-19 10:50:38 -04:00
b4b21be707
Fix area composition feathering not working properly.
2023-03-19 02:00:52 -04:00
50099bcd96
Support multiple paths for embeddings.
2023-03-18 03:08:43 -04:00
2e73367f45
Merge T2IAdapterLoader and ControlNetLoader.
...
Workflows will be auto updated.
2023-03-17 18:17:59 -04:00
ee46bef03a
Make --cpu have priority over everything else.
2023-03-13 21:30:01 -04:00
0e836d525e
use half() on fp16 models loaded with config.
2023-03-13 21:12:48 -04:00
986dd820dc
Use half() function on model when loading in fp16.
2023-03-13 20:58:09 -04:00
54dbfaf2ec
Remove omegaconf dependency and some ci changes.
2023-03-13 14:49:18 -04:00
83f23f82b8
Add pytorch attention support to VAE.
2023-03-13 12:45:54 -04:00
a256a2abde
--disable-xformers should not even try to import xformers.
2023-03-13 11:36:48 -04:00
0f3ba7482f
Xformers is now properly disabled when --cpu used.
...
Added --windows-standalone-build option, currently it only opens
makes the code open up comfyui in the browser.
2023-03-12 15:44:16 -04:00
e33dc2b33b
Add a VAEEncodeTiled node.
2023-03-11 15:28:15 -05:00
1de86851b1
Try to fix memory issue.
2023-03-11 15:15:13 -05:00
2b1fce2943
Make tiled_scale work for downscaling.
2023-03-11 14:58:55 -05:00
9db2e97b47
Tiled upscaling with the upscale models.
2023-03-11 14:04:13 -05:00
cd64111c83
Add locon support.
2023-03-09 21:41:24 -05:00
c70f0ac64b
SD2.x controlnets now work.
2023-03-08 01:13:38 -05:00
19415c3ace
Relative imports to test something.
2023-03-07 11:00:35 -05:00
165be5828a
Fixed import ( #44 )
...
* fixed import error
I had an
ImportError: cannot import name 'Protocol' from 'typing'
while trying to update so I fixed it to start an app
* Update main.py
* deleted example files
2023-03-06 11:41:40 -05:00
501f19eec6
Fix clip_skip no longer being loaded from yaml file.
2023-03-06 11:34:02 -05:00
afff30fc0a
Add --cpu to use the cpu for inference.
2023-03-06 10:50:50 -05:00
47acb3d73e
Implement support for t2i style model.
...
It needs the CLIPVision model so I added CLIPVisionLoader and CLIPVisionEncode.
Put the clip vision model in models/clip_vision
Put the t2i style model in models/style_models
StyleModelLoader to load it, StyleModelApply to apply it
ConditioningAppend to append the conditioning it outputs to a positive one.
2023-03-05 18:39:25 -05:00
cc8baf1080
Make VAE use common function to get free memory.
2023-03-05 14:20:07 -05:00
798c90e1c0
Fix pytorch 2.0 cross attention not working.
2023-03-05 14:14:54 -05:00
16130c7546
Add support for new colour T2I adapter model.
2023-03-03 19:13:07 -05:00
9d00235b41
Update T2I adapter code to latest.
2023-03-03 18:46:49 -05:00
ebfcf0a9c9
Fix issue.
2023-03-03 13:18:01 -05:00
4215206281
Add a node to set CLIP skip.
...
Use a more simple way to detect if the model is -v prediction.
2023-03-03 13:04:36 -05:00
fed315a76a
To be really simple CheckpointLoaderSimple should pick the right type.
2023-03-03 11:07:10 -05:00
94bb0375b0
New CheckpointLoaderSimple to load checkpoints without a config.
2023-03-03 03:37:35 -05:00
c1f5855ac1
Make some cross attention functions work on the CPU.
2023-03-03 03:27:33 -05:00
1a612e1c74
Add some pytorch scaled_dot_product_attention code for testing.
...
--use-pytorch-cross-attention to use it.
2023-03-02 17:01:20 -05:00
69cc75fbf8
Add a way to interrupt current processing in the backend.
2023-03-02 14:42:03 -05:00
9502ee45c3
Hopefully fix a strange issue with xformers + lowvram.
2023-02-28 13:48:52 -05:00
b31daadc03
Try to improve memory issues with del.
2023-02-28 12:27:43 -05:00
2c5f0ec681
Small adjustment.
2023-02-27 20:04:18 -05:00
86721d5158
Enable highvram automatically when vram >> ram
2023-02-27 19:57:39 -05:00
75fa162531
Remove sample_ from some sampler names.
...
Old workflows will still work.
2023-02-27 01:43:06 -05:00
9f4214e534
Preparing to add another function to load checkpoints.
2023-02-26 17:29:01 -05:00
3cd7d84b53
Fix uni_pc sampler not working with 1 or 2 steps.
2023-02-26 04:01:01 -05:00
dfb397e034
Fix multiple controlnets not working.
2023-02-25 22:12:22 -05:00
af3cc1b5fb
Fixed issue when batched image was used as a controlnet input.
2023-02-25 14:57:28 -05:00
d2da346b0b
Fix missing variable.
2023-02-25 12:19:03 -05:00
4e6b83a80a
Add a T2IAdapterLoader node to load T2I-Adapter models.
...
They are loaded as CONTROL_NET objects because they are similar.
2023-02-25 01:24:56 -05:00
fcb25d37db
Prepare for t2i adapter.
2023-02-24 23:36:17 -05:00
cf5a211efc
Remove some useless imports
2023-02-24 12:36:55 -05:00
87b00b37f6
Added an experimental VAEDecodeTiled.
...
This decodes the image with the VAE in tiles which should be faster and
use less vram.
It's in the _for_testing section so I might change/remove it or even
add the functionality to the regular VAEDecode node depending on how
well it performs which means don't depend too much on it.
2023-02-24 02:10:10 -05:00
62df8dd62a
Add a node to load diff controlnets.
2023-02-22 23:22:03 -05:00
f04dc2c2f4
Implement DDIM sampler.
2023-02-22 21:10:19 -05:00
2976c1ad28
Uni_PC: make max denoise behave more like other samplers.
...
On the KSamplers denoise of 1.0 is the same as txt2img but there was a
small difference on UniPC.
2023-02-22 02:21:06 -05:00
c9daec4c89
Remove prints that are useless when xformers is enabled.
2023-02-21 22:16:13 -05:00
a7328e4945
Add uni_pc bh2 variant.
2023-02-21 16:11:48 -05:00
d80af7ca30
ControlNetApply now stacks.
...
It can be used to apply multiple control nets at the same time.
2023-02-21 01:18:53 -05:00
00a9189e30
Support old pytorch.
2023-02-19 16:59:03 -05:00
137ae2606c
Support people putting commas after the embedding name in the prompt.
2023-02-19 02:50:48 -05:00
2326ff1263
Add: --highvram for when you want models to stay on the vram.
2023-02-17 21:27:02 -05:00
09f1d76ed8
Fix an OOM issue.
2023-02-17 16:21:01 -05:00
d66415c021
Low vram mode for controlnets.
2023-02-17 15:48:16 -05:00
220a72d36b
Use fp16 for fp16 control nets.
2023-02-17 15:31:38 -05:00
6135a21ee8
Add a way to control controlnet strength.
2023-02-16 18:08:01 -05:00
4efa67fa12
Add ControlNet support.
2023-02-16 10:38:08 -05:00
bc69fb5245
Use inpaint models the proper way by using VAEEncodeForInpaint.
2023-02-15 20:44:51 -05:00
cef2cc3cb0
Support for inpaint models.
2023-02-15 16:38:20 -05:00
07db00355f
Add masks to samplers code for inpainting.
2023-02-15 13:16:38 -05:00
e3451cea4f
uni_pc now works with KSamplerAdvanced return_with_leftover_noise.
2023-02-13 12:29:21 -05:00
f542f248f1
Show the right amount of steps in the progress bar for uni_pc.
...
The extra step doesn't actually call the unet so it doesn't belong in
the progress bar.
2023-02-11 14:59:42 -05:00
f10b8948c3
768-v support for uni_pc sampler.
2023-02-11 04:34:58 -05:00
ce0aeb109e
Remove print.
2023-02-11 03:41:40 -05:00
5489d5af04
Add uni_pc sampler to KSampler* nodes.
2023-02-11 03:34:09 -05:00
1a4edd19cd
Fix overflow issue with inplace softmax.
2023-02-10 11:47:41 -05:00
509c7dfc6d
Use real softmax in split op to fix issue with some images.
2023-02-10 03:13:49 -05:00
7e1e193f39
Automatically enable lowvram mode if vram is less than 4GB.
...
Use: --normalvram to disable it.
2023-02-10 00:47:56 -05:00
324273fff2
Fix embedding not working when on new line.
2023-02-09 14:12:02 -05:00
1f6a467e92
Update ldm dir with latest upstream stable diffusion changes.
2023-02-09 13:47:36 -05:00
773cdabfce
Same thing but for the other places where it's used.
2023-02-09 12:43:29 -05:00
df40d4f3bf
torch.cuda.OutOfMemoryError is not present on older pytorch versions.
2023-02-09 12:33:27 -05:00
e8c499ddd4
Split optimization for VAE attention block.
2023-02-08 22:04:20 -05:00
5b4e312749
Use inplace operations for less OOM issues.
2023-02-08 22:04:13 -05:00
3fd87cbd21
Slightly smarter batching behaviour.
...
Try to keep batch sizes more consistent which seems to improve things on
AMD GPUs.
2023-02-08 17:28:43 -05:00
bbdcf0b737
Use relative imports for k_diffusion.
2023-02-08 16:51:19 -05:00
708138c77d
Remove print.
2023-02-08 14:51:18 -05:00
047775615b
Lower the chances of an OOM.
2023-02-08 14:24:27 -05:00
853e96ada3
Increase it/s by batching together some stuff sent to unet.
2023-02-08 14:24:00 -05:00
c92633eaa2
Auto calculate amount of memory to use for --lowvram
2023-02-08 11:42:37 -05:00
BlenderNeko
comfyanonymous
藍+85CD
EllangoK
sALTaccount
Francesco Yoshi Gobbo
Yurii Mazurevich
edikius