+j<ddlZddlZddlZddlZddlZddlmZddlm Z m Z ddl m Z Gdde j ZGdde j ZGd d e j ZGd d e j ZGd de j ZGdde ZdefdZdS)N)override)ComfyExtensionio)SkipLayerGuidanceDiTcNeZdZedZedejfdZeZdS)TripleCLIPLoaderc tjdddtjdt jdtjdt jdtjdt jdgtjg S) Nrzadvanced/loadersz"[Recipes] sd3: clip-l, clip-g, t5 clip_name1 text_encoders)options clip_name2 clip_name3)node_idcategory descriptioninputsoutputs)rSchemaComboInput folder_pathsget_filename_listClipOutputclss 6/home/wildlama/comfy/ComfyUI/comfy_extras/nodes_sd3.py define_schemazTripleCLIPLoader.define_schema sy&'>|\5STc5d5dee|\5STc5d5dee|\5STc5d5dee       returnctjd|}tjd|}tjd|}tj|||gtjd}t j|S)Nr embeddings) ckpt_pathsembedding_directory)rget_full_path_or_raisecomfysd load_clipget_folder_pathsr NodeOutput)rr r r clip_path1 clip_path2 clip_path3clips rexecutezTripleCLIPLoader.executes!8*UU !8*UU !8*UU x!!j*j-QgshEFRhShS!TT}T"""rN) __name__ __module__ __qualname__ classmethodrrr*r/r(rrrr sW   [  #BM###[#IIIrrcPeZdZedZeddejfdZeZdS)EmptySD3LatentImagec dtjddtjdddtjdtjdddtjdtjdd d d gtjg S) Nr6zmodel/latent/sd3widthidefaultminmaxstepheight batch_sizei)r;r<r=)rrrr)rrIntrnodesMAX_RESOLUTIONLatentrrs rrz!EmptySD3LatentImage.define_schema(sy)' Wd@T[] ^^ XtAU\^ __ \1! FF    ""    rrAr ctj|d|dz|dzgtjtj}t j|ddS)Nr9)devicedtype)samplesdownscale_ratio_spacial)torchzerosr&model_managementintermediate_deviceintermediate_dtyperr*)rr8r?r@latents rr/zEmptySD3LatentImage.execute7sj"fk5A:FuOeOyOyO{O{DIDZDmDmDoDoppp}ANNOOOrN)rA) r0r1r2r3rrr*r/generater4rrr6r6'sb   [  PPR]PPP[PHHHrr6cNeZdZedZedejfdZeZdS)CLIPTextEncodeSD3ctjddgdtjdtjdddtjdddtjd ddtjd d d gd gtjgS)NrTz sd3 promptzadvanced/conditioningr.clip_lT) multilinedynamic_promptsclip_gt5xxl empty_paddingnone empty_prompt)r advanced)rsearch_aliasesrrr)rrrrStringr Conditioningrrs rrzCLIPTextEncodeSD3.define_schema@sy'(>, f%% D$OO D$OO 4NN8P[_`` &&((    rr c|dk}||}t|dkr|rg|d<t|dkr|rg|d<n||d|d<t|dkr|rg|d<n||d|d<t|dt|dkr|d}t|dt|dkrB|dxx|dz cc<t|dt|dkBt|dt|dkrB|dxx|dz cc<t|dt|dkBtj||S)Nr\rglrZ)tokenizelenrr*encode_from_tokens_scheduled) rr.rVrYrZr[ no_paddingtokensemptys rr/zCLIPTextEncodeSD3.executeRs"f, v&& v;;!   F3K v;;!   F3KK--//4F3K u::??z?!F7OO"mmE227;F7O vc{  s6#;// / /MM"%%EfSk""S%5%555s uSz) fSk""S%5%555fSk""S%5%555s uSz) fSk""S%5%555}T>>vFFGGGrN) r0r1r2r3rrr*r/encoder4rrrTrT?s\  [ "HBMHHH[H0FFFrrTc`eZdZedejfdZeddejfdZeZ dS)ControlNetApplySD3r ctjdddtjdtjdtjdtjdtjdtjd d d d d tjdd d d dtjdd d d dgtjdtjdgdS)NrnzApply Controlnet with VAEzmodel/conditioning/controlnetpositivenegative control_netvaeimagestrength?$@{Gz?r: start_percentMbP? end_percent) display_nameT)rr}rrr is_deprecated) rrrar ControlNetVaeImageFloatrrs rrz ControlNetApplySD3.define_schemaosy(44%%j11%%j11 ##M22 U##w''z3CTPTUU#TYZZ}csRWXX &&J&??&&J&??%    rNc P|dkrtj||S|dd} i} g} ||fD]} g} | D]}|d}|dd}|| vr | |}nH|| |||f|g}|||| |<||d<d|d<|d|g}| || | tj| d| dS)NrrAcontrol)rs extra_concatFcontrol_apply_to_uncond)rr*movedimcopyget set_cond_hintset_previous_controlnetappend)rrprqrrrtrurzr|rs control_hintcnetsout conditioningctd prev_cnetc_netns rr/zControlNetApplySD3.executesS q===844 4}}R++ %x0  LA!  aDIIKKEE)T22 %%!),EE',,..<<\8VcepUqADSU=WWE11)<<<',E)$$) /4+,qT1I JJqMMMM}SVSV,,,rN) r0r1r2r3rrrr*r/apply_controlnetr4rrrnrnnso bi   [ ,--prp}---[-:rrncReZdZdZedZedejfdZeZ dS)SkipLayerGuidanceSD3z Enhance guidance towards detailed dtructure by having another set of CFG negative with skipped layers. Inspired by Perturbed Attention Guidance (https://arxiv.org/abs/2403.17377) Experimental implementation by Dango233@StabilityAI. ctjdddtjdtjdddd tjd d d d dtjddd dddtjddd dddgtjgdS)Nrzadvanced/guidancezNGeneric version of SkipLayerGuidance node that can be used on every DiT model.modellayersz7, 8, 9FT)r;rWr^scaleg@rwrxg?r:rzryrvr{)r;r<r=r>r^r|g333333?)rrrrris_experimental)rrModelrr`rrrs rrz"SkipLayerGuidanceSD3.define_schemasy*(hw'' )uW[\\w$SQQ#3UZeijj}dSXcghh !!!    rr cNt|||||S)N)rrrzr| double_layers)rr/)rrrrrzr|s rr/zSkipLayerGuidanceSD3.executes7#%%--EVcq|MS-TT TrN) r0r1r2__doc__r3rrr*r/skip_guidance_sd3r4rrrrsk   [ $T"-TTT[T rrcLeZdZedeeejfdZdS) SD3Extensionr cFKtttttgSr)rr6rTrnr)selfs r get_node_listzSD3Extension.get_node_lists!       rN) r0r1r2rlisttyper ComfyNoderr4rrrrsE  T$r|*<%=   X   rrr c"KtSr)rr4rrcomfy_entrypointrs >>r)rcomfy.sdr&comfy.model_managementrCrLtyping_extensionsrcomfy_api.latestrrcomfy_extras.nodes_slgrrrr6rTrnrrrr4rrrs &&&&&&////////777777r|8",0,,,,, ,,,^66666666r     2<   B      >     r