Commit Graph

2929 Commits

Author SHA1 Message Date
Jedrzej Kosinski 76b9ed1f2d Merge branch 'master' into patch_hooks_improved_memory 2024-11-21 17:46:25 -06:00
Jedrzej Kosinski c044c3ba58 Revert change, does not work 2024-11-21 16:12:39 -06:00
Jedrzej Kosinski 9a69ccf944 Allow both FLOATS and FLOAT for floats_strength input 2024-11-21 16:11:49 -06:00
Jedrzej Kosinski 1c86976f8e On Cond/Cond Pair nodes, removed opt_ prefix from optional inputs 2024-11-21 15:50:10 -06:00
comfyanonymous 8f0009aad0 Support new flux model variants. 2024-11-21 08:38:23 -05:00
comfyanonymous 41444b5236 Add some new weight patching functionality.
Add a way to reshape lora weights.

Allow weight patches to all weight not just .weight and .bias

Add a way for a lora to set a weight to a specific value.
2024-11-21 07:19:17 -05:00
comfyanonymous 772e620e32 Update readme. 2024-11-20 20:42:51 -05:00
Jedrzej Kosinski d38c535771 Turn off hook patch caching when only 1 hook present in sampling, replace some current_hook = None with calls to self.patch_hooks(None) instead to avoid a potential edge case 2024-11-20 18:57:18 -06:00
comfyanonymous 07f6eeaa13 Fix mask issue with attention_xformers. 2024-11-20 17:07:46 -05:00
comfyanonymous 22535d0589 Skip layer guidance now works on stable audio model. 2024-11-20 07:33:06 -05:00
Jedrzej Kosinski 35016983fb Small cleanup of comments 2024-11-19 17:49:57 -06:00
Jedrzej Kosinski 59891b0f96 Made encode_from_tokens_scheduled work when no hooks are set on patcher 2024-11-19 17:17:01 -06:00
comfyanonymous 898615122f Rename add_noise_mask -> noise_mask. 2024-11-19 15:31:09 -05:00
comfyanonymous 156a28786b Add boolean to InpaintModelConditioning to disable the noise mask. 2024-11-19 07:31:29 -05:00
Yoland Yan f498d855ba
Add terminal size fallback (#5623) 2024-11-19 03:34:20 -05:00
comfyanonymous b699a15062 Refactor inpaint/ip2p code. 2024-11-19 03:25:25 -05:00
Jedrzej Kosinski 9b2b1303b7 Removed a .to call on results of calculate_weight in patch_hook_weight_to_device that was screwing up the intermediate results for fp8 prior to being passed into stochastic_rounding call 2024-11-18 20:42:51 -06:00
Chenlei Hu 9cc90ee3eb
Update UI screenshot in README (#5666)
* Update UI ScreenShot in README

* Remove legacy UI screenshot file

* nit

* nit
2024-11-18 16:50:34 -05:00
Jedrzej Kosinski 9fe3db4c3a For encode_from_tokens_scheduled, allow start_percent and end_percent in add_dict to limit which scheduled conds get encoded for optimization purposes 2024-11-18 12:25:17 -06:00
Jedrzej Kosinski 365170af95 Merge branch 'master' into patch_hooks_improved_memory 2024-11-18 08:43:19 -06:00
Jedrzej Kosinski de6013ccc4 Increased MemoryCounter minimum memory to leave free by *2 until a better way to get inference memory estimate of currently loaded models exists 2024-11-18 08:08:00 -06:00
Jedrzej Kosinski 0850ae5c04 Remove unnecessary torch.no_grad calls for hook patches 2024-11-18 07:38:11 -06:00
Jedrzej Kosinski e844695292 Fixed issue with setting weights from hooks instead of copying them, added additional memory_counter check when caching hook patches 2024-11-18 07:25:53 -06:00
comfyanonymous 9a0a5d32ee Add a skip layer guidance node that can also skip single layers.
This one should work for skipping the single layers of models like Flux
and Auraflow.

If you want to see how these models work and how many double/single layers
they have see the "ModelMerge*" nodes for the specific model.
2024-11-18 02:20:43 -05:00
Jedrzej Kosinski f465004a58 Fix cached_hook_patches not respecting target_device/memory_counter results 2024-11-17 12:52:40 -06:00
comfyanonymous d9f90965c8 Support block replace patches in auraflow. 2024-11-17 08:19:59 -05:00
comfyanonymous 41886af138 Add transformer options blocks replace patch to mochi. 2024-11-16 20:48:14 -05:00
Chenlei Hu 22a1d7ce78
Fix 3.8 compatibility in user_manager.py (#5645) 2024-11-16 20:42:21 -05:00
Jedrzej Kosinski a20be20ac7 Added apply_to_conds to Set CLIP Hooks, modified relevant code to allow text encoding to automatically apply hooks to output conds when apply_to_conds is set to True 2024-11-16 17:37:57 -06:00
Jedrzej Kosinski e177149ae4 Made opt_hooks append by default instead of replace, renamed comfy.hooks set functions to be more accurate 2024-11-16 16:40:45 -06:00
Chenlei Hu 4ac401af2b
Update web content to release v1.3.44 (#5620)
* Update web content to release v1.3.44

* nit
2024-11-15 20:17:15 -05:00
comfyanonymous 5fb59c8475 Add a node to block merge auraflow models. 2024-11-15 12:47:55 -05:00
Jedrzej Kosinski bcc6a22178 Made WrapperHook functional, added another wrapper/callback getter, added ON_DETACH callback to ModelPatcher 2024-11-14 08:06:02 -06:00
comfyanonymous 122c9ca1ce Add advanced model merging node for mochi. 2024-11-14 07:51:20 -05:00
comfyanonymous 3b9a6cf2b1 Fix issue with 3d masks. 2024-11-13 07:18:30 -05:00
comfyanonymous 3748e7ef7a Fix regression. 2024-11-13 04:24:48 -05:00
Jedrzej Kosinski 96b2080971 Merge branch 'master' into patch_hooks_improved_memory 2024-11-12 16:43:30 -06:00
Jedrzej Kosinski 1470719db6 Added clip scheduling support to all other native ComfyUI text encoding nodes (sdxl, flux, hunyuan, sd3) 2024-11-12 10:55:19 -06:00
Jedrzej Kosinski 5909b06b2e Removed Register/Direct hook nodes since they were present only for testing, removed diff-related weight hook calculation as improved_memory removes unload_model_clones and using sample time registered hooks is less hacky 2024-11-12 09:05:19 -06:00
Jedrzej Kosinski 1766d903ad Fixed existing weight hook_patches (pre-registered) not working properly for CLIP 2024-11-12 08:12:12 -06:00
comfyanonymous 8ebf2d8831 Add block replace transformer_options to flux. 2024-11-12 08:00:39 -05:00
Bratzmeister a72d152b0c
fix --cuda-device arg for AMD/HIP devices (#5586)
* fix --cuda-device arg for AMD/HIP devices

CUDA_VISIBLE_DEVICES is ignored for HIP devices/backend. Instead it uses HIP_VISIBLE_DEVICES. Setting this environment variable has no side effect for CUDA/NVIDIA so it can safely be set in any case and vice versa.

* deleted accidental if
2024-11-12 06:53:36 -05:00
comfyanonymous eb476e6ea9 Allow 1D masks for 1D latents. 2024-11-11 14:44:52 -05:00
Jedrzej Kosinski 9330745f27 Merge branch 'improved_memory' into patch_hooks_improved_memory 2024-11-11 11:26:36 -06:00
Jedrzej Kosinski 4195dfb032 Merge branch 'master' into patch_hooks_improved_memory 2024-11-11 11:26:27 -06:00
Jedrzej Kosinski 66b3386ee7 Updated different hook types to reflect actual progress of implementation, initial scaffolding for working WrapperHook functionality 2024-11-11 10:13:02 -06:00
Jedrzej Kosinski b12cc83c5b Modified callbacks and wrappers so that unregistered types can be used, allowing custom_nodes to have their own unique callbacks/wrappers if desired 2024-11-11 09:05:07 -06:00
Jedrzej Kosinski 638c4086a3 Fixed inconsistency of results when schedule_clip is set to False, small renaming/typo fixing, added initial support for ControlNet extra_hooks to work in tandem with normal cond hooks, initial work on calc_cond_batch merging all subdicts in returned transformer_options 2024-11-11 08:41:08 -06:00
Dr.Lt.Data 2d28b0b479
improve: add descriptions for clip loaders (#5576) 2024-11-11 05:37:23 -05:00
comfyanonymous 8b275ce5be Support auto detecting some zsnr anime checkpoints. 2024-11-11 05:34:11 -05:00