+j ddlmZddlZddlZddlmZddlmZm Z m Z er ddl m Z ddlm Z dZdZdd ZdddddgfddZdS)) annotationsN) WrappersMP) TYPE_CHECKINGCallableOptional) ModelPatcher)WrapperExecutorz torch.compiletorch_compile_kwargscompiled_module_dictdict[str, Callable]returnrcdfd }|S)zK Create a wrapper that will refer to the compiled_diffusion_model. executorr c i}D]S\}}tj|j|||<tj|j||T||i||D]+\}}tj|j||,S#|D]+\}}tj|j||,wxYw)N)itemscomfyutilsget_attr class_objset_attr)rargskwargs orig_moduleskeyvaluer s E/home/wildlama/comfy/ComfyUI/comfy_api/torch_helpers/torch_compile.pyapply_torch_compile_wrapperz@apply_torch_compile_factory..apply_torch_compile_wrappers EL288:: E E U$)K$8$89KS$Q$Q S! $$X%7eDDDD8T,V,,*0022 E E U $$X%7eDDDD El0022 E E U $$X%7eDDDD Es A1B55AC7)rr )r rs` rapply_torch_compile_factoryrs/ E E E E E E '&Fdiffusion_modelmodelrbackendstroptionsOptional[dict[str, str]]mode Optional[str]dynamicOptional[bool]keys list[str]cT|tjt|sdg}|||||d} i} |D]+} t jdd|| i| | | <,t| } |tjt| | |j t<dS)aX Perform torch.compile that will be applied at sample time for either the whole model or specific params of the BaseModel instance. When keys is None, it will default to using ["diffusion_model"], compiling the whole diffusion_model. When a list of keys is provided, it will perform torch.compile on only the selected modules. r!)r#r%r' fullgraphr)r")r Nr) remove_wrappers_with_keyr APPLY_MODEL COMPILE_KEYtorchcompileget_model_objectradd_wrapper_with_key model_optionsTORCH_COMPILE_KWARGS) r"r#r%r'r.r)r+rrcompile_kwargscompiled_modulesr wrapper_funcs rset_torch_compile_wrapperr;!s "":#9;GGG #!" N % !!,,S11! !! /-L z5{LQQQ0>E,---r )r r r r) r"rr#r$r%r&r'r(r)r*r+r,) __future__rr2 comfy.utilsrcomfy.patcher_extensionrtypingrrrcomfy.model_patcherrr r1r7rr;rr rrAs"""""" ......44444444448000000777777 -''''"cg26%ae/@.A$?$?$?$?$?$?$?r