0fbefb8428
Refactored code to store wrappers and callbacks in transformer_options, added apply_model and diffusion_model.forward wrappers
2024-11-03 06:22:48 -06:00
3bcbcce88d
Merge branch 'master' into patch_hooks
2024-10-31 18:34:05 -05:00
30c0c81351
Add a way to patch blocks in SD3.
2024-10-29 00:48:32 -04:00
13b0ff8a6f
Update SD3 code.
2024-10-28 21:58:52 -04:00
5cbb01bc2f
Basic Genmo Mochi video model support.
...
To use:
"Load CLIP" node with t5xxl + type mochi
"Load Diffusion Model" node with the mochi dit file.
"Load VAE" with the mochi vae file.
EmptyMochiLatentVideo node for the latent.
euler + linear_quadratic in the KSampler node.
2024-10-26 06:54:00 -04:00
4bbdf2bfe5
Merge branch 'master' into patch_hooks
2024-10-23 21:10:46 -05:00
5a8a48931a
remove attention abstraction ( #5324 )
2024-10-22 14:02:38 -04:00
da6c0455cc
Added forward_timestep_embed_patch type, added helper functions on ModelPatcher for emb_patch and forward_timestep_embed_patch, added helper functions for removing callbacks/wrappers/additional_models by key, added custom_should_register prop to hooks
2024-09-24 12:40:54 +09:00
f04229b84d
Add emb_patch support to UNetModel forward ( #4779 )
2024-09-04 14:35:15 -04:00
d31e226650
Unify RMSNorm code.
2024-08-28 16:56:38 -04:00
33fb282d5c
Fix issue.
2024-08-14 02:51:47 -04:00
3b71f84b50
ONNX tracing fixes.
2024-08-04 15:45:43 -04:00
25853d0be8
Use common function for casting weights to input.
2024-07-30 10:49:14 -04:00
79040635da
Remove unnecessary code.
2024-07-30 05:01:34 -04:00
66d35c07ce
Improve artifacts on hydit, auraflow and SD3 on specific resolutions.
...
This breaks seeds for resolutions that are not a multiple of 16 in pixel
resolution by using circular padding instead of reflection padding but
should lower the amount of artifacts when doing img2img at those
resolutions.
2024-07-29 20:48:50 -04:00
10b43ceea5
Remove duplicate code.
2024-07-24 01:12:59 -04:00
f8f7568d03
Basic SD3 controlnet implementation.
...
Still missing the node to properly use it.
2024-06-27 18:43:11 -04:00
bb1969cab7
Initial support for the stable audio open model.
2024-06-15 12:14:56 -04:00
1281f933c1
Small optimization.
2024-06-15 02:44:38 -04:00
605e64f6d3
Fix lowvram issue.
2024-06-12 10:39:33 -04:00
73ce178021
Remove redundancy in mmdit.py ( #3685 )
2024-06-11 06:30:25 -04:00
8c4a9befa7
SD3 Support.
2024-06-10 14:06:23 -04:00
0920e0e5fe
Remove some unused imports.
2024-05-27 19:08:27 -04:00
8508df2569
Work around black image bug on Mac 14.5 by forcing attention upcasting.
2024-05-21 16:56:33 -04:00
83d969e397
Disable xformers when tracing model.
2024-05-21 13:55:49 -04:00
1900e5119f
Fix potential issue.
2024-05-20 08:19:54 -04:00
0bdc2b15c7
Cleanup.
2024-05-18 10:11:44 -04:00
98f828fad9
Remove unnecessary code.
2024-05-18 09:36:44 -04:00
46daf0a9a7
Add debug options to force on and off attention upcasting.
2024-05-16 04:09:41 -04:00
ec6f16adb6
Fix SAG.
2024-05-14 18:02:27 -04:00
bb4940d837
Only enable attention upcasting on models that actually need it.
2024-05-14 17:00:50 -04:00
b0ab31d06c
Refactor attention upcasting code part 1.
2024-05-14 12:47:31 -04:00
2aed53c4ac
Workaround xformers bug.
2024-04-30 21:23:40 -04:00
2a813c3b09
Switch some more prints to logging.
2024-03-11 16:34:58 -04:00
cb7c3a2921
Allow image_only_indicator to be None.
2024-02-29 13:11:30 -05:00
b3e97fc714
Koala 700M and 1B support.
...
Use the UNET Loader node to load the unet file to use them.
2024-02-28 12:10:11 -05:00
6bcf57ff10
Fix attention masks properly for multiple batches.
2024-02-17 16:15:18 -05:00
f8706546f3
Fix attention mask batch size in some attention functions.
2024-02-17 15:22:21 -05:00
3b9969c1c5
Properly fix attention masks in CLIP with batches.
2024-02-17 12:13:13 -05:00
c661a8b118
Don't use numpy for calculating sigmas.
2024-02-07 18:52:51 -05:00
89507f8adf
Remove some unused imports.
2024-01-25 23:42:37 -05:00
2395ae740a
Make unclip more deterministic.
...
Pass a seed argument note that this might make old unclip images different.
2024-01-14 17:28:31 -05:00
6a7bc35db8
Use basic attention implementation for small inputs on old pytorch.
2024-01-09 13:46:52 -05:00
c6951548cf
Update optimized_attention_for_device function for new functions that
...
support masked attention.
2024-01-07 13:52:08 -05:00
aaa9017302
Add attention mask support to sub quad attention.
2024-01-07 04:13:58 -05:00
0c2c9fbdfa
Support attention mask in split attention.
2024-01-06 13:16:48 -05:00
3ad0191bfb
Implement attention mask on xformers.
2024-01-06 04:33:03 -05:00
8c6493578b
Implement noise augmentation for SD 4X upscale model.
2024-01-03 14:27:11 -05:00
79f73a4b33
Remove useless code.
2024-01-02 01:50:29 -05:00
61b3f15f8f
Fix lowvram mode not working with unCLIP and Revision code.
2023-12-26 05:02:02 -05:00
Jedrzej Kosinski
comfyanonymous
contentis
Dango233