+jTRUddlZddlZddlZddlZddlZddlZddlmZmZm Z ddl m Z ddl m Z ddlmZmZddlZddlmZiZe eefed<ded efd ZGd d eZGd dZdZGddeZGddeZGddZGddeZGddZ GddeZ!dZ"dZ#Gdde!Z$dS) N)SequenceMappingDict) ModelPatcher) DynamicPrompt)ABCabstractmethod)is_linkNODE_CLASS_CONTAINS_UNIQUE_ID class_typereturnc|tvr t|Stj|}d|divt|<t|S)N UNIQUE_IDhidden)r nodesNODE_CLASS_MAPPINGS INPUT_TYPESgetvalues)r class_defs 7/home/wildlama/comfy/ComfyUI/comfy_execution/caching.pyinclude_unique_id_in_inputrsk222,Z88)*5I0;y?T?T?V?V?Z?Z[ceg?h?h?o?o?q?q0q!*- ( 44cHeZdZdZedZdZdZdZdZ dZ dS) CacheKeySetc"i|_i|_dSN)keys subcache_keysself dynpromptnode_idsis_changed_caches r__init__zCacheKeySet.__init__s rc"Ktr)NotImplementedError)r!r#s radd_keyszCacheKeySet.add_keyss!###rcNt|jSr)setrr!s r all_node_idszCacheKeySet.all_node_ids#s49>>##$$$rc4|jSr)rrr+s r get_used_keyszCacheKeySet.get_used_keys&sy!!!rc4|jSr)rrr+s rget_used_subcache_keysz"CacheKeySet.get_used_subcache_keys)s!((***rc8|j|dSr)rrr!node_ids r get_data_keyzCacheKeySet.get_data_key,sy}}Wd+++rc8|j|dSr)rrr2s rget_subcache_keyzCacheKeySet.get_subcache_key/s!%%gt444rN) __name__ __module__ __qualname__r%r r(r,r.r0r4r6rrrrs   $$^$%%%"""+++,,,55555rrceZdZdZdS) Unhashablec.td|_dS)NNaN)floatvaluer+s rr%zUnhashable.__init__3s5\\ rN)r7r8r9r%r:rrr<r<2s#"""""rr<c t|ttttt t dfr|St|tr8tdt| DSt|tr8tttjd|DStS)NcPg|]#\}}t|t|f$Sr: to_hashable).0kvs r zto_hashable..<s-[[[tq!;q>>;q>>:[[[rc,g|]}t|Sr:rC)rEis rrHzto_hashable..>s0M0M0MAQ0M0M0Mr) isinstanceintr?strboolbytestyper frozensetsorteditemsrzip itertoolscountr<)objs rrDrD6s#UCud4jjABB C ! ![[vciikkGZGZ[[[\\\ C " "Y_..0M0M0M0M0MNNOOO||rc$eZdZfdZdZxZS) CacheKeySetIDc\t|||||_dSr)superr%r"r!r"r#r$ __class__s rr%zCacheKeySetID.__init__Ds+ H.>???"rcK|D]e}||jvr |j|s'|j|}||df|j|<||df|j|<fdSNr )rr"has_nodeget_noderr!r#r3nodes rr(zCacheKeySetID.add_keysHs H HG$)##>**733 >**733D")4 +=!>DIg +2D4F*GD w ' ' H Hr)r7r8r9r%r( __classcell__r]s@rrYrYCsN#####HHHHHHHrrYcHeZdZfdZdefdZdZdZdZdZ dZ xZ S) CacheKeySetInputSignaturecjt|||||_||_dSr)r[r%r"r$r\s rr%z"CacheKeySetInputSignature.__init__Ss5 H.>???" 0rr cdSNFr:r+s rinclude_node_id_in_inputz2CacheKeySetInputSignature.include_node_id_in_inputXsurcK|D]|}||jvr |j|s'|j|}||j|d{V|j|<||df|j|<}dSr_)rr"r`raget_node_signaturerrbs rr(z"CacheKeySetInputSignature.add_keys[s H HG$)##>**733 >**733D'+'>'>t~w'W'W!W!W!W!W!W!WDIg +2D4F*GD w ' ' H Hrc$Kg}|||\}}|||||d{V|D]2}|||||d{V3t|Sr)get_ordered_ancestryappendget_immediate_node_signaturerD)r!r"r3 signature ancestors order_mapping ancestor_ids rrmz,CacheKeySetInputSignature.get_node_signaturees #'#<#r NOT_IDEMPOTENTinputsANCESTOR)r`r?rarrr$rrkhasattrrwrrprRrr ) r!r"r3ancestor_order_mappingrcr rrrrxkeyruancestor_socketancestor_indexs rrqz6CacheKeySetInputSignature.get_immediate_node_signaturems!!'** "%LL> !!!'**,' -j9 t'<'@'@'I'I!I!I!I!I!I!IJ  ( ( * * &wyBR/S/S &XaXp &vPQ[v\v\ &   W % % %h&++--(( 5 5Cvc{## 517.o!7 !D  #z>?&S!TUUUU  #vc{!34444rcBg}i}|||||||fSr)get_ordered_ancestry_internal)r!r"r3rsrts rroz.CacheKeySetInputSignature.get_ordered_ancestrys1   **9gy-XXX-''rc||sdS||d}t|}|D]k}t ||rT||d}||vrB||t |dz ||<|||||ldS)Nrxr)r`rarRrr rplenr) r!r"r3rsrtrx input_keysr|rus rrz7CacheKeySetInputSignature.get_ordered_ancestry_internals!!'**  F##G,,X6FKKMM**  i iCvc{## i$Sk!n m33$$[11114Y!1CM+.66y+yZghhh  i ir) r7r8r9r%rNrkr(rmrqrorrdres@rrgrgRs11111 $HHH&&&,((( i i i i i i irrgceZdZddZdZdZdZdZdZdZ d Z d Z d Z d Z d ZedZdZdZdZdZdZdZdZdS) BasicCacheFcz||_d|_||_||i|_i|_t |_dSrj) key_class initializedenable_providerscache subcachesr*_pending_store_tasks)r!rrs rr%zBasicCache.__init__sE"  0 % ' ),!!!rcK||_|||||_|j|d{V||_d|_dS)NT)r"r cache_key_setr(r$rr s r set_promptzBasicCache.set_promptse"!^^IxAQRR ))(333333333 0rc|jsJ|j}|jD])}||}*|Sr)rrr,rrunion)r!r#subcaches rr,zBasicCache.all_node_idssf%2244--// ? ?H~~h&;&;&=&=>>HHrct|j}g}|jD]}||vr|||D] }|j|= dSr)r*rr.rrp)r! preserve_keys to_remover|s r _clean_cachezBasicCache._clean_cachesxD.<<>>??  : & &C-''  %%%  C 3  rct|j}g}|jD]}||vr|||D] }|j|= dSr)r*rr0rrp)r!preserve_subcachesrr|s r_clean_subcacheszBasicCache._clean_subcachess| !3!J!J!L!LMM > & &C,,,  %%% $ $Cs## $ $rch|jsJ||dSr)rrrr+s r clean_unusedzBasicCache.clean_unuseds;  rc dSrr:r!kwargss rpollzBasicCache.poll rcx|jsdS|j|}||jvr |j|SdSrrrr4rr!r3 cache_keys r get_localzBasicCache.get_localsG 4&33G<<  " ":i( (trc`|jsJ|j|}||j|<dSrrr!r3r@rs r set_localzBasicCache.set_locals9&33G<< % 9rcK|jsJ|j|}||j|<||||d{VdSr)rrr4r_notify_providers_storers r_set_immediatezBasicCache._set_immediatesg&33G<< % 9**7IuEEEEEEEEEEErcK|jsdS|j|}||jvr |j|S|||d{V}| ||j|<|SdSr)rrr4r_check_providers_lookup)r!r3rexternal_results r_get_immediatezBasicCache._get_immediates 4&33G<<  " ":i( ( $ < >N".t/H/HSZ\g/h/hiiD-11$777**4+D+LMMM e e e c(2D2M c c`a c cdddddddd e  e esA8D D: %D55D:cKddlm} |||d{VdS#t$r0}|d|jjd|Yd}~dSd}~wwxYw)Nr)rrz async store error: )rron_storerrr]r7)rrrrrs rrzBasicCache._safe_provider_store s:::::: d##G[99 9 9 9 9 9 9 9 9 9 d d d OObh.@.Ibb_`bb c c c c c c c c c ds( A"%AA"cKddlm}m}m}m}m}|jsdS|sdS||rdS|||}|dS|D]} | |s| |d{V} | t| |s$| d| j j dkt| jtt fs$| d| j j dddlm} | | jt| jcS#t($r0} | d| j j d | Yd} ~ d} ~ wwxYwdS) Nrrz Provider z returned invalid typez returned invalid outputs) CacheEntry)rrrz error on lookup: )rrrrrrrrr on_lookuprKrr]r7rlisttuple executionrrr) r!r3rrrrrrrrresultrrs rrz"BasicCache._check_providers_lookups*              $ 4##%% 4 ! !) , , 4%%gy99 ?4,,.. f fH f,,W55'11'::::::::%%fj99!(gH4F4O(g(g(ghhh %fntUmDD!(jH4F4O(j(j(jkkk 444444%:D%E))E.cBt|dot|dS)Nrr)rz)r!r@s rrz'BasicCache._is_external_cacheable_value6s!ui((AWUD-A-AArc|jr|jsdS |j|ddS#t$rYdSwxYw)Nr )rr"rarrr2s r_get_class_typezBasicCache._get_class_type9sh t~ 2 >**73377 bII I   22 s-A A Acddlm}m}m} ||}|dS|||||S#t $r&}|d|d|Yd}~dSd}~wwxYw)Nr) CacheContext_serialize_cache_keyr)r3r cache_key_hashz'Failed to build cache context for node z: )rrrrrrr)r!r3rrrrrrs rrzBasicCache._build_contextAs^^^^^^^^^^ 11)<%%lD99  !$.11H+3DN< (!!$.,@UVVVVVVVVVrcx|jsJ|j|}||jvr |j|SdSr)rrr6r)r!r3rs r _get_subcachezBasicCache._get_subcacheYsF)::7CC 4> ) )>,/ /4rcg}|jD]%}|||j|d&|jD]7}|||j|d8|S)N)r|r@)rr)rrprrecursive_debug_dump)r!rr|s rrzBasicCache.recursive_debug_dumpas: B BC MM# 3@@ A A A A> i iC MM3DN3>  K #   Y ' ' '99)DDI#!),,  I'' 22E}tt rcnK||}|dS||d{VSr)rrr!r3rs rrzHierarchicalCache.getsI##G,, =4))'222222222rcj||}|dSt||Sr)rrrrs rrzHierarchicalCache.get_locals5##G,, =4##E7333rctK||}|J|||d{VdSr)rrr!r3r@rs rr*zHierarchicalCache.setsS##G,,   ""7E22222222222rcp||}|Jt|||dSr)rrrrs rrzHierarchicalCache.set_locals?##G,,   UGU33333rcpK||}|J|||d{VSr)rr)r!r3rrs rensure_subcache_forz%HierarchicalCache.ensure_subcache_forsM##G,,   ++G\BBBBBBBBBrr) r7r8r9r%rrrr*rrrdres@rrrisGGGGGG$333 444 333 444 CCCCCCCrrcDeZdZdZdZdZdZdZdZdZ dZ d Z d S) NullCachec KdSrr:r s rrzNullCache.set_prompt  rcgSrr:r+s rr,zNullCache.all_node_idss rcdSrr:r+s rrzNullCache.clean_unusedrrc dSrr:rs rrzNullCache.pollrrc KdSrr:r2s rrz NullCache.gets trcdSrr:r2s rrzNullCache.get_localstrc KdSrr:r!r3r@s rr*z NullCache.setrrcdSrr:rs rrzNullCache.set_localrrc K|Srr:)r!r3rs rrzNullCache.ensure_subcache_fors  rN) r7r8r9rr,rrrrr*rrr:rrrrs               rrcReZdZd fd ZfdZdZdZdZdZd Z fd Z xZ S) LRUCachedFct||||_d|_d|_i|_i|_dS)Nrr)r[r%max_sizemin_generation generationused_generationchildren)r!rr rr]s rr%zLRUCache.__init__sJ 5EFFF  ! rcKt|||d{V|xjdz c_|D]}||dS)Nr)r[rr  _mark_used)r!r"r#r$r3r]s rrzLRUCache.set_promptstgg  H6FGGGGGGGGG 1 % %G OOG $ $ $ $ % %rcvtjjkrjjkrvxjdz c_fdjD}|D]#}j|=j|=|jvrj|=$tjjkrjjkvdS)Nrc@g|]}j|jk|Sr:)rr )rEr|r!s rrHz)LRUCache.clean_unused..s/fffd6J36ORVRe6e6e6e6e6er)rrr r r rrr)r!rr|s` rrzLRUCache.clean_unuseds$*oo --$2E2W2W   1 $  ffff fffI  + +JsO(-$-'' c*$*oo --$2E2W2W rcfK||||d{VSr)rrr2s rrz LRUCache.gets>    ((111111111rc`|j|}||j|j|<dSdSr)rr4r rrs rrzLRUCache._mark_useds;&33G<<  .2oD  + + + ! rchK|||||d{VSr)rrrs rr*z LRUCache.sets@    ((%888888888rch||t|||dSr)rrrrs rrzLRUCache.set_locals2    T7E22222rcKt||d{V|j|d{V|||j|}g|j|<|D]O}|||j||j|P|Sr)r[rrr(rr4rrp)r!r3rrchild_idr]s rrzLRUCache.ensure_subcache_forsgg&&w ========= )),777777777    &33G<< #% i $ W WH OOH % % % M) $ + +D,>,K,KH,U,U V V V V r)r F) r7r8r9r%rrrrr*rrrdres@rrrs%%%%%    222>>> 999333         rrg?g?cLeZdZdfd ZdZfdZfdZfdZddZxZ S) RAMPressureCacheFc^t|d|i|_dS)Nrr)r[r% timestampsrs rr%zRAMPressureCache.__init__s. A8HIIIrc.|dSr)rr+s rrzRAMPressureCache.clean_unuseds rcKtj|j|j|<t ||d{VdSr)timerrr4r[r*r!r3r@r]s rr*zRAMPressureCache.setsZDHIKK*77@@Aggkk'5)))))))))))rcKtj|j|j|<t |d{VSr)r rrr4r[r)r!r3r]s rrzRAMPressureCache.getsRDHIKK*77@@AWW[[)))))))))rctj|j|j|<t ||dSr)r rrr4r[rr!s rrzRAMPressureCache.set_local sFDHIKK*77@@A '5)))))rc tjj|krdSg}jD]\}|sjjkrtjjz z}t fd  |j |z}tj ||j ftjj|kr|r| \}}j=j dj dj dtjj|kr|dSdSdSdS)Ncr|dS|D]}t|ttfr |*t|tjr=|jjdkr-||zz t|trj j krddS)Ncpugꌠ9Y>)F) rKrrtorchTensordevicerPnumel element_sizerrr )routputr| ram_usagescan_list_for_ram_usager!s rr.z=RAMPressureCache.ram_release..scan_list_for_ram_usages?F%))F!&4-88)//7777#FEL99)fm>PTY>Y>Y!V\\^^f6I6I6K6K%KK #FL99)d>RSV>W[_[j>j>j$( ))r)psutilvirtual_memory availablerrSrr %RAM_CACHE_OLD_WORKFLOW_OOM_MULTIPLIERRAM_CACHE_DEFAULT_RAM_USAGErbisectinsortrpopr) r!target free_active clean_list cache_entry oom_score_r|r-r.s ` @@@r ram_releasezRAMPressureCache.ram_releases  " " , 6 6 F $ 0 0 2 2 N N C 4#7#<#O#O>4?UYUijmUnCnoI3I ) ) ) ) ) ) ) ) $ #K$7 8 8 8  "I M*y$/#2F&L M M M M#%%/&88Z8"((IAq# 3  $ $S$ / / / O  T * * * M  c4 ( ( ( #%%/&88Z888888888rr) r7r8r9r%rr*rrr=rdres@rrrs   ***************$)$)$)$)$)$)$)$)rr)%rr4rUr/r r'typingrrrcomfy.model_patcherrcomfy_execution.graphrabcrr rcomfy_execution.graph_utilsr r rMrN__annotations__rrr<rDrYrgrrrrr3r2rr:rrrDs  **********,,,,,,//////######## //////13tCI3335354555555555#5550""""""""    H H H H HK H H HBiBiBiBiBi BiBiBiHQQQQQQQQf/C/C/C/C/C /C/C/Cb:66666z666x# ),%9)9)9)9)9)x9)9)9)9)9)r