3jfzSrSSKJr SSKrSSKrSSKrSSKJs Jr SSK r SSK r SSK r SSKJrJrJr SSKrSSKJr SrSr"SS \R.5r\R2"S 5r"S S \R.5r"S S\R.5r"SS\R.5r"SS\5rS\4Sjrg)zR SAM3 (Segment Anything 3) nodes for detection, segmentation, and video tracking. )overrideN)ComfyExtensionioui)Fractionc USSnURS5n/nUbUHnUSRXS9nUSbUSRU5OSnUc?[R"URSURS[R US9nUR XxURS S545 M U$USSRXS9nURS5nUbURU5nO?[R"URSURS[R US9nUR XxS45 U$) z?Extract list of (text_embeddings, text_mask) from conditioning.rsam3_multi_condNconddevicedtypeattention_maskrr max_detections)gettotorchonesshapeint64append) conditioningr r cond_metamultipromptsentryembmasks 7/home/wildlama/comfy/ComfyUI/comfy_extras/nodes_sam3.py_extract_text_promptsr!s?Q"I MM+ ,EG E-""&">C9>?O9P9\5)*--f5bfD|zz#))A, ! EKKX^_ NNCuyy1A1'EF G  N1oa ##6#?}}-.  776?D::ciilCIIaL TZ[D1~& Nc ^^^UUU4Sjn US::aU "5$Sn UR5uppX- X- nn[S[XU -- 55n[S[U UU -- 55n[T[XU --55n[T[UUU --55nUU::dUU::aU "5$UUU2UU2SS24n[R R URS5RSS5SSS S S 9nURXgS 9nUU- UU- nnTRS Sunn[UT- U-5[UT- U-5nn[UT- U-5[UT- U-5nnUU::dUU::aU "5$TSUU2UU24RS5RS5n [U5H*n![R"U SS SS9n"URUU"S9n M, [R"U UU4S SS9n#[R "SSTTXgS 9n$U#U$SS2SS2UU2UU24'[R"TRS5RS5TT4S SS9n%U$SS:U%SS:-R#5$)znRefine a coarse detector mask via SAM decoder, cropping to the detection box. Returns: [1, H, W] binary mask c>[R"TRS5RS5TT4SSS9SS:R5$)NrbilinearFsizemode align_corners)F interpolate unsqueezefloat)HW coarse_masksr _coarse_fallback&_refine_mask.._coarse_fallback/sR k33A6@@C1a&#-UDDEGIJKLQEG Tr"rg?Nr r%disabledcropr .)r5r5Fr& mask_inputs)tolistmaxintmincomfyutilscommon_upscaler,movedimrrranger*r+forward_segmentrzerosr-)& sam3_modelorig_image_hwcr0box_xyxyr.r/r r iterationsr1pad_fracx1y1x2y2bwbhcx1cy1cx2cy2r8 crop_1008 crop_framecrop_hcrop_wmask_hmask_wmx1my1mx2my2 mask_logit_ coarse_input refined_crop full_mask coarse_fulls& ` `` r _refine_maskrf*s TQ!!H__&NBB WbgB aRx-'( )C aR"x-'( )C aRx-'( )C aR"x-'( )C czSCZ!! #c'3s7BQB. /D **4>>!+<+D+DR+KTSWYcjt*uIV9J3Yc FF!&&rs+NFF37V#$c#'F*:&;C37V#$c#'F*:&;C czSCZ!!S#c'3s723==a@JJ1MJ : }}Zlchi // /U ==662BchiL Aq!QvCI(4IaCGSW$%-- 5 5a 8 B B1 EQPQFYcsxyK q\A +a.1"4 5 < < >>r"cX\rSrSrSr\S5r\SS\R4Sjj5r Sr g) SAM3_DetectXzMOpen-vocabulary detection and segmentation using text, box, or point prompts.c[R"SSS/SQ[RRSSS9[RRSSS9[R RSSS S S 9[R RS S S S S S9[RRSSS S SS9[RRSSS S SS9[RRSSSSSSS9[RRSSSSSSS9[RRSSS S!S"9/ [RRS#5[R RS 5/S$9$)%Nrhz SAM3 Detectimage/detection)sam3zsegment anythingzopen vocabularyztext detectionsegmentmodel display_nameimagerTz%Text conditioning from CLIPTextEncoderpoptionaltooltipbboxesz Bounding boxes to segment within)rp force_inputrsrtpositive_coordszIPositive point prompts as JSON [{"x": int, "y": int}, ...] (pixel coords)negative_coordszINegative point prompts as JSON [{"x": int, "y": int}, ...] (pixel coords) threshold??{Gz?rpdefaultr?r=steprefine_iterationsrz8SAM decoder refinement passes (0=use raw detector masks)rprr?r=rtindividual_masksFz(Output per-object masks instead of unionrprrtmasksnode_idrpcategorysearch_aliasesinputsoutputs) rSchemaModelInputImage Conditioning BoundingBoxStringFloatIntBooleanMaskOutputclss r define_schemaSAM3_Detect.define_schema[szyy!&&gwW=wW=%%n>\`kR%S$$XHRVaepR$S  1@Q_cnr}LM  1@Q_cnr}LM{cWZ`cjno 0?R\]cdjkvp q   !3BT^cnX Y w'%%h/!  r"Nreturnc ^A^BURun mAmBn [RRUSSS24R SS5SSSSS9n UAUB4S jn SnUb[ U[ 5(aU "U/5nU/U -nO[ U[5(a[U5S :aw[ US [5(a_UVs/sHnU(aU "U5OSPM nn[U5U :a.URU(aUSOS5 [U5U :aM.O2[ U[5(a[U5S :aU "U5nU/U -nU(a[R"U5O/nU(a[R"U5O/n[U5S :=(d [U5S :n[RRU5 [RR5nURR!5nURR"nSnU(aUVs/sHnUS TB- S-US TA- S-/PM snUVs/sHnUS TB- S-US TA- S-/PM sn-nS/[U5-S /[U5--n[$R&"U/UUS 9[$R&"U/[$R(US 9S.nUb[U5S :a [+UUU5O/n[U5S :n/n/n[RR-U 5n[/U 5GHn U U U S-R1UUS9n!Sn"UbUU bUU R1UUS9n"/n#/n$Ub}UR3U!US9n%[/[5S US- 55Hn&UR3U!U%S9n%M [6R8"U%TATB4SSS9n'U$RU'S S :R;55 U"bU(dU"S Hn(U(R=5un)n*n+n,[$R&"U)U+S- - S-U*U,S- - S-/U)U+S- -S-U*U,S- -S-///UUS9n-UR3U!U-S9n%[/[5S US- 55Hn&UR3U!U%S9n%M [6R8"U%TATB4SSS9n'U$RU'S S :R;55 M UGH;un.n/n0U"U!U.U/U"UTATB4S9n1U1SS n2U1SS n3U1SS n4U3R?5n5U5U:n6U2U6RA5n7U5U6RA5n8U4U6n9U8RCSS9SU0n:U7U:n7U8U:n8U9U:n9[EU7U85Hbun;n URU#5 [U$5S :a^[$RH"U$S S9n>U (aURU>5 OURU>S :RKS S9R;55 OU (aCUR[$RL"S TATB[RRO5S95 OAUR[$RL"TATB[RRO5S95 URQS5 GM [RRO5n?UV=s/sHn=U=R1U?5PM nn=U (a[$RH"US S9O[$RR"U5n@[TRV"U@U5$s snfs snfs snfs sn=f)N.r3r4r r5r%r6r7c>/nUHEnUSUSS- -T- nUSUSS- -T- nURX4UST- UST- /5 MG [R"U/[RS9$)Nxwidthryheightr)rrtensorfloat32)box_listcoordsdcxcyr.r/s r _boxes_to_tensor-SAM3_Detect.execute.._boxes_to_tensorzsFfqzA~-2fq{Q.!3 rqzA~q{QGH<< > >r"rrrr) point_coords point_labelsr ) point_inputsr:Fr&r) box_inputs)text_embeddings text_maskboxesry orig_sizerscoresrT) descending)rrrrscoredimr ),rr@rArBrC isinstancedictlistlenrjsonloadsmodel_managementload_model_gpuget_torch_devicern get_dtypediffusion_modelrrint32r! ProgressBarrDrrEr=r*r+r-r<sigmoidcpuargsortziprfcatanyrFintermediate_deviceupdatestackr NodeOutput)CrrnrqrrurwrxryrrBCimage_inrper_frame_boxesshared frame_boxespos_ptsneg_pts has_pointsr rrGrp all_coords all_labels cond_listhas_textall_bbox_dicts all_maskspbarbframeb_boxesframe_bbox_dicts frame_masksr`rar box_cxcywhrrrPrQsam_boxrrmax_detresults pred_boxesrrprobskeep kept_boxes kept_scores kept_masksorderboxrmcombinedidevmask_outr.r/sC @@r executeSAM3_Detect.executess[[ 1a;;--eC!Gn.D.DR.KTSWYcjt-u ?  &$'')6(3#)(Q,FD))c&kAo*VTUYX\B]B]ms"tms^iK#3K#@UY#Yms"t/*Q.#**/?2+>W[\/*Q.FD))c&kAo)&1#)(Q,2A$**_-b1@$**_-b\A%9W)9  --e4''88: %%'[[00  JQR'Q1S6A:,afqj4.?@'RJQR'Q1S6A:,afqj4.?@'RSJs7|+qcCL.@@J % j\v V % j\U[ \L KWJbgjkwgx{|g|),FCE y>A% {{&&q)qAQqsO&&fE&BEG*q/A/M)!,//vU/K! K''77L7Y s1&7!&;<=A!+!;!;Ez!;!ZJ>}}Zq!f:]bc""DGaK#6#6#89"8")!*J%/%6%6%8NBB#llrBqDyD.@219PTBT-U/1BqDyD.@219PTBT-U-W,X28GG",!;!;Eg!;!VJ"3q*;a*?#@A%/%?%?S]%?%^ B==1a&zafgD&&Q! ':':'<=#-8A3G$?i!Y1a&J%W-a0  *1-(+(y('-113 #Dkoo/ "4[ #++t+JC$++"3q6]s1v!&s1vA!75QRUVWRXCY!&u-#? "*j9FAs&&|"E!HaaFEK\(^_:58A<  ! !"2 3;!# 99[a8#$$X.$$hl%7%7A%7%>%D%D%FG#$$U[[AqAWAWAkAkAm%no$$U[[Ae>T>T>h>h>j%kl KKNUX%%99;)23AQTT$Z 32B599YA. T]H^}}X~66k#u,SRx4s=^7% ^< __)NNNNrzrF __name__ __module__ __qualname____firstlineno____doc__ classmethodrrrr__static_attributes__rr"r rhrhXsHW  .K7oqo|o|K7K7r"rhSAM3_TRACK_DATAcX\rSrSrSr\S5r\SS\R4Sjj5r Sr g) SAM3_VideoTrackizDTrack objects across video frames using SAM3's memory-based tracker.c[R"SSS/SQ[RRSSSS9[RRSSS 9[R RS S S S S 9[R RSSS SS 9[RRSSSSSSSS9[RRSSSSSSS9[RRSSSSSS 9/[RS!S!S 9/S"9$)#NrzRun SAM3 Video Trackrk)rlvideotrack propagateimageszVideo frames as batched images)rprtrnro initial_maskTz5Mask(s) for the first frame to track (one per object)rrrz;Text conditioning for detecting new objects during trackingdetection_thresholdrzr{r|r}z,Score threshold for text-prompted detection.)rprr?r=rrt max_objectsr@zZMax tracked objects. Initial masks count toward this limit. 0 uses the internal cap of 64.rdetect_intervalr zIRun detection every N frames (1=every frame). Higher values save compute.)rprr?rt track_datar) rrrrrrrrr SAM3TrackDatarrs r rSAM3_VideoTrack.define_schemas+yy%/&BxhHhiwW= n>TXcZ [%%n>\`kh%i4CXbekntwCM{| ]PQWX^`kG H .=NXY_`kv w$$\ $M  r"Nrc URupp[RRU5 [RR 5n UR R 5n UR RnUSSS24RSS5nSnUbURS5RXS9n[RRU5nSnUb6[U5S:a'[XLU 5VVVs/sH unnnUU4PM nnnnOUc [S5eUR!UUUUXVX|U S9 nX4US '["R$"U5$s snnnf) N.r3r4r r rz4Either initial_mask or conditioning must be provided) r  initial_masksr text_promptsnew_det_threshrr target_device target_dtyper)rr@rrrrnrrrCr,rrArrr! ValueError forward_videorr)rr rnr rrrrNr.r/rr rrG frames_in init_masksrrrrraresults r rSAM3_VideoTrack.executesS\\ a --e4''88: %%'[[00 37O++B2   #%//255V5QJ{{&&q)  #L(9A(=syy'-&##L|#LxhNyy#SV\_fjku5$CUZade     r") )gQ?Gz?gQ?)r|rzr')(\?g)\(?r-)zG?g333333?g{Gz?)g(\?g?Gz?)g?g(\?g(\?)g{Gz?r,RQ?)rzrzrz)r/r/gp= ף?)g ףp= ?g?gQ?)gGz?r0gQ?)gzG?g(\?r.c$X4nU[R;a[RU$[R"/SQ/SQ/SQ/SQ/SQ//SQ/SQ/SQ/SQ/SQ//SQ/SQ/SQ/SQ/SQ//SQ/SQ/SQ/SQ/SQ//SQ/SQ/SQ/SQ/SQ//SQ/SQ/SQ/SQ/SQ//SQ/SQ/SQ/SQ/SQ//SQ/SQ/SQ/SQ/SQ//SQ/SQ/SQ/SQ/SQ//SQ/SQ/SQ/SQ/SQ// [RS9n//pT[ S5HnX6R US 5R US 5n[R"UR5RS 5RS 5S 5n[R"US S S S 9SS :n URURU55 URU RU55 M US RupUS RupXEXX4[RU'[RU$)N)r r r )r rr )rr r)r r r)rrr )r rrr rr )r r r r r3)stridepadding)rr)r$ _glyph_cacherrboolrDrepeat_interleaver*padr-r, max_pool2drrr)r scalekeyatlasglyphsoutlinesrgpaddedoghgwohows r _get_glyphsSAM3_TrackPreview._get_glyphsVso #00 0$11#6 6 WWWW 5 WWWW 5 WWWW 5 WWWW 5 WWWW 5 WWWW 5 WWWW 5 WWWW 5 WWWW 5 WWWW 5   rrA**5!4FFuaPAUU1779..q1;;A> JFfa1=dCaGA MM!$$v, ' OOADDL )  !""/5.P&&s+ --c22r"chURSSupgURn[RX5uppp[R "XHUR S9n[U5Vs/sHn[U5PM nn[U5X--U- nUUS-- nX;S-- n[U5GHunnUUX---nUS- US- nn[SU*5[SU*5nn[XU- 5[XU- 5nnUU:a6UU:a0UU-UU-nnSUUUUU- -2UUUU- -24U UUU2UU24'[SU*5[SU*5n n[XU- 5[XU- 5n"n!U!U:dMU"U :dMUU-UU -nnXUUU!U- -2UUU"U - -24U UUU!2U U"24'GM gs snf)zKDraw a number on a GPU tensor [H, W, 3] float 0-1 at (cx, cy) with outline.Nrr r r) rr r$rFrrrstrr>r enumerater=r?)#rnumberrrcolorr:r.r/r r=r>rBrCrDrEcolor_trdigstotal_wx0y0idxoy0ox0osy1osx1osy2osx2fy1fx1sy1sx1sy2sx2s# r _draw_number_gpu"SAM3_TrackPreview._draw_number_gpuss{{2A+<+H+H+W("",,u5;;G #F , 1A ,d)rz*U2 'Q,  '\dODAqa2:&&BAvrAvCQs1sd|$DRS)3rs7+;$Dd{td{:sTzSefc#tDy/)3sDI+>>? DQUIW[\`W`L`@ab1rc{CB3KC22vBBCSyS3Y8R#XS[bc#s3w-'S#c'])::;F1Ic#gsSVwFV"X|S9RASUS5n[,R>"XS9RASSU5n[7U 5GHnUb'UURS:aUURC5nO[,RD"XxS5nU S:GaU"UUUS-RGU 55n[HRJ"URM5Xx4SS9SnURGU 5nUS:nUROSS9nURO5(afURG[,R05RQSS9nWUn URSS5n![,RT"U!USU- -U U--U5nURWSS9RYSS9n"UW-RWSS9U"-n#UW-RWSS9U"-n$U"S:n%UR[S/5n&[]SUS-5n'U"RM5R_5S- RYSS9Ra5Rc5n([7U 5Hn)U%U)(dM[eU$U)5[eU#U)5n+n*UR8U)[;UR85-n,[gU'U(U)5n-[]SU-S-S-5n.[hRkUU)U*U+U,U-S9 U)[;U&5:dMU&U)S :dM[hRkU[eU&U)S!-5U*U+S"U---S-U,U.S9 M URmURYSS5RoS#5Rq55 O>URmURYSS5RoS#5Rq55 [RrRuUS$S%9n/URwURyU/R{SS%955 GM URwURyS55 SSS5 [|R~"[R"[R"US&[|RR5/5S'9$s snf!,(df  Nj=f)(Nr unpack_masks packed_masksrr rn_framessam3_track_preview_z.mp4w)r(h264i)rateyuv420pr3rr rnearest)r'r(rzrr4)r4r9)r?r)r:r|drrgb24)format)r)Ecomfy.ldm.sam3.trackerrdruuidr@rr folder_pathsget_temp_directoryuuid4hexospathjoinavopen add_streamrroundrrpix_fmtremptyuint8numpyrrDCOLORSrrarangeviewclonerFrr*r+r-rargmaxr,wheresumclamp_rr=sqrtlongr<r>r?r$r`copy_mul_byte VideoFrame from_ndarraymuxencodereformatrrr PreviewVideo SavedResult FolderTypetemp)0rrr r&r(rdpackedr.r/rN_objrvgputemp_dirfilenamefilepathoutputstream frame_cpuframe_nprRcolors_tgrid_ygrid_xtr frame_binaryr frame_gpu bool_masksany_mask obj_idx_map color_overlaymask_3darearrhasr label_scale size_capsobj_idx_cx_cyrL obj_scale score_scalevframes0 r rSAM3_TrackPreview.executesr 8N++&  <<?FLLOq >!*-qu||A Qu$$557224()9)9"1)=(>dC77<<3 WWXC (F&&vHU3:=NPT4U&VFFLFM&FN A!5;;?I (Hqy <>h>7>>1>ED$v-22x2@DHB$v-22x2@DHB(C'^^Hb9F"%ac"2K!%!2!2!4r!9 A Aa A H M M O V V XI#(<w<<'*2g;'7R[9IC$'JJwSZZ/H$IE(+K79K(LI*-aQ!1C*DK->>y'SVX[]bjs>t&V439N 1 B B9cRXY`RadgRgNhCFaR[mH[^_H_afny!C!{$0OOI$4$4Q$:$?$?$D$I$I$KLOOELLA$6$;$;C$@$E$E$GH33HW3M 6== )JKLOP JJv}}T* +k)l}}"bmmN`N`1a0b cdd[)`) (s4&BX.9/X) (I'X.BX.X.)D!X.)X.. X<r)r3)Nrzr))rrrrrrrrr5 staticmethodrFr`rrrrrr"r r$r$;srv    FL338cc4Ge GeGer"r$cX\rSrSrSr\S5r\SS\R4Sjj5r Sr g) SAM3_TrackToMaskiz3Select tracked objects by index and output as mask.c [R"SSS[RSSS9[RRSSSSS 9/[R R S S S9/S 9$) NrzSAM3 Track to Maskrkrroobject_indicesrtzNComma-separated object indices to include (e.g. '0,2,3'). Empty = all objects.rr)rrprrr)rrrrrrrrs r rSAM3_TrackToMask.define_schemasqyy&-&##L|#L  0?OY[(x z wW=  r"rc SSKJn USnUSupVUcKUSn[R"[R "XuU[ RR5S95$URSURSpUR5(aURS5V s/sH@oR5R5(dM'[U R55PMB n n U V s/sHn SU s=::aU:dMO MU PM n n O[[U55n U (dF[R"[R "XuU[ RR5S95$USS2U S4R!5n U SSHn XSS2U 4-n M U"U 5R#S5R%5n [&R("XU4S S S 9SS2S4n [R"U 5$s sn fs sn f) Nrrcrerrfrr ,r%Fr&)rurdrrrrFr@rrrstripsplitisdigitr>rrDrr,r-r*r+)rrrrdrr.r/rrrRindices union_packedunionrs r rSAM3_TrackToMask.executes7N++& >:&A==Q1U=S=S=g=g=i!jk k<<?FLLO5    ! !/=/C/CC/H`/H!GGIL]L]L_~s1779~/HG`")<'QQ!^e^q^q'Grs' 33 .*?\g7",,g7T +, 4%bll4%n[e [e|-'r||-'` N  r"