+jAPBSSKrSSKrSSKJr SSKJrJrJr SSKrSSK J r J r J r J r JrJrJrJrJrJrJrJrJrJrJrJr SSKJrJr SSKJrJrJ r J!r! SSK"J#r#J$r$ SSK%J&r& SS K'J(r( SS K)J*r*J+r+J,r, SS K-J.r. "S S \5r/"SS\5r0\Sr1S\1S\2\34Sjr4S\2\34Sjr5S\2\34Sjr6S7S\1S\7S\7S\8\3S-4Sjjr9S\1S\8\34Sjr:S\2\3S\;4SjrS8S\2\3S \8\3S!\7S"\7S\=\2\\8\3\;44 S#jjr?S$\2\S%\8\3S\;4S&jr@SrAS'rBS(rC\AS)4S\=\1S4S*\;S+\;S\24S,jjrDS9S-\3S.\3S/\3S0\7S1\7S2\/\74S-S3\E\3\#4S-S\;4S4jjrFS9S5\2S0\7S1\7S2\/\74S-S3\E\3\#4S-S\=\;\2\344 S6jjrGg):N)Path)CallableLiteral TypedDict)add_missing_tag_for_asset_idbulk_update_enrichment_levelbulk_update_is_missingbulk_update_needs_verifydelete_orphaned_seed_assetdelete_references_by_idsensure_tags_existget_asset_by_hashget_reference_by_idget_references_for_prefixesget_unenriched_references(mark_references_missing_outside_prefixesreassign_asset_referencesremove_missing_tag_for_asset_idset_reference_system_metadataupdate_asset_hash_and_mime) SeedAssetSpecbatch_insert_seed_assets) get_mtime_ns is_visiblelist_files_recursivelyverify_file_unchanged)HashCheckpointcompute_blake3_hash)extract_image_dimensions)extract_file_metadata)compute_relative_filenameget_comfy_models_folders!get_name_and_tags_from_asset_path)create_sessioncH\rSrSr%\\S'\\S'\\S'\\S'\\S'Srg) _RefInfo.ref_id file_pathexistsstat_unchanged needs_verifyN)__name__ __module__ __qualname____firstlineno__str__annotations__bool__static_attributes__r-2/home/wildlama/comfy/ComfyUI/app/assets/scanner.pyr&r&.s KN Lr6r&c@\rSrSr%\S-\S'\\S'\\\S'Sr g)_AssetAccumulator6Nhashsize_dbrefsr-) r.r/r0r1r2r3intlistr&r5r-r6r7r9r96s * L x.r6r9modelsinputoutputrootreturncUS:XaV/n[5Hup#URU5 M UVs/sH"n[RR U5PM$ sn$US:Xa3[RR [ R "55/$US:Xa3[RR [ R"55/$/$s snf)NrArBrC)r"extendospathabspath folder_pathsget_input_directoryget_output_directory)rDbases_bucketpathsps r7get_prefixes_for_rootrR?s x68NG LL 9,12Eq"E22 w @ @ BCDD x A A CDEE I 3s)Cc`SnUVVs/sHn[U5Ho"PM M snn$s snnf)z3Get all known asset prefixes across all root types.r@)rR) all_rootsrDrQs r7get_all_known_prefixesrULs.&CI# I)$-B4-HA-HA) II Is*c$/n[5Hup[R"U5=(d /nUHn[S[ U5R 55(dM/[R "X5nU(dMN[RRU5nSn[ U5nUH:nUR[RRU55(dM8Sn O U(dMURU5 M GM U$)Nc38# UHn[U5v M g7f)N)r).0parts r7 'collect_models_files..WsI4HDz$''4HsFT) r"rKget_filename_listallrparts get_full_pathrHrIrJis_relative_toappend) out folder_namerN rel_filesrel_pathabs_pathallowedabs_pbs r7collect_models_filesrjRsC68  22;?E2 !HIDN4H4HIII#11+HHwwx0HGNE''(:;;"Gw 8$"9" Jr6collect_existing_pathsupdate_missing_tagsc P[U5nU(dU(a [5$S$[XUS9n0nUHnURUR5nUc(UR UR /S.nXUR'Sn Sn [URUS[R"URSS9S9n US R#UR$URU U UR&S .5 M /n /n /n/n/n[5nUR)5GHunnUS nUS n[+SU55n[-SU55nUHnUS(dUR#US5 M#US(a2UR#US5 US(aU R#US5 US(aMkUS(aMwU R#US5 M UcdU(aU(a [/UU5 OFUH@nUS(dMUR1[R2R5US55 MB GM-U(a=UH#nUS(aMUR#US5 M% U(a [7UUS9 OOU(a [=UUSS9 UH@nUS(dMUR1[R2R5US55 MB GM [?X5 [U5nUVs/sH nUU;dM UPM nn[AXSS9 [AUUSS9 [CX SS9 [CX SS9 U(aU$S$![a Sn GN[a' Sn [R"S UR5 GN[ a/n Sn [R"S URU 5 Sn A GNSn A ff=f![8a#n [R:"SUU 5 Sn A GNPSn A ff=f![8a#n [R:"SUU 5 Sn A GNSn A ff=fs snf)aReconcile asset references with filesystem for a root. - Toggle needs_verify per reference using mtime/size stat check - For hashed assets with at least one stat-unchanged ref: delete stale missing refs - For seed assets with all refs missing: delete Asset and its references - Optionally add/remove 'missing' tags based on stat check in this root - Optionally return surviving absolute paths Args: session: Database session root: Root type to scan collect_existing_paths: If True, return set of surviving file paths update_missing_tags: If True, update 'missing' tags based on file status Returns: Set of surviving absolute paths if collect_existing_paths=True, else None N)include_missing)r;r<r=FTr<follow_symlinks)mtime_dbr< stat_resultzPermission denied accessing %szOSError checking %s: %sr=)r(r)r*r+r,r;c3*# UH oSv M g7f)r+Nr-rXrs r7rZ2sync_references_with_filesystem..s>A./sc34# UHoS(+v M g7f)r*Nr-rts r7rZrvs84ak//4sr*r(r+r,r))asset_idz-Failed to remove missing tag for asset %s: %s automatic)rxoriginz*Failed to add missing tag for asset %s: %s)value)"rRsetrgetrx asset_hash size_bytesrmtime_nsrHstatr)FileNotFoundErrorPermissionErrorloggingdebugOSErrorra reference_idr,itemsanyr]r addrIrJr Exceptionwarningrr r r )sessionrDrkrlprefixesrowsby_assetrowaccr+r*e to_set_verifyto_clear_verify stale_ref_idsto_mark_missingto_clear_missing survivorsaida_hashr= any_unchanged all_missingru stale_setr(s r7sync_references_with_filesystemrhs.%T*H .su8D8 &+> D.0Hll3<<( ;>>cnnbQC%(S\\ " GF2IGGCMM4HN F ** ]] "0 # 0 0   /B "M!#O!M!#O"$%INN$SV6{>>> 8488 AX;&&q{3!" ''( 4^$#**1X;7%&&q/@/@$$Qx[1 > *7C8A{{! bggooa n&EF  {{!((85#3GcJ#! V,Ws;WA{{ bggooa n=>W%^W4M"I,;WO&vY?VvOOW74@7$4EBW4@WUC.98D8c! F KF MM:CMM J GF MM3S]]A F F Gl!OOGa V LcSTUU VXs`7M < O O3 P#P# O,O O$N;;O O0 O++O03 P =PP c[5n[UUSSS9nUR5 U=(d [5sSSS5 $!,(df  g=f![a+n[ R "SX5 [5sSnA$SnAff=f)zrSync a single root's references with the filesystem. Returns survivors (existing paths) or empty set on failure. T)rkrlNzfast DB scan failed for %s: %s)r$rcommitr|rr exception)rDsessrrs r7sync_root_safelyrso   7'+$( I KKM%   :DDu s9 A/A A AAA B  BB B rc[5n[X5nUR5 UsSSS5 $!,(df  g=f![a!n[R "SU5 SnAgSnAff=f)zMark references as missing when outside the given prefixes. This is a non-destructive soft-delete. Returns count marked or 0 on failure. Nz!marking missing assets failed: %sr)r$rrrrr)rrcountrs r7$mark_missing_outside_prefixes_safelyrsV   L99L>rc Sn/n[5nUHtnUbU"5(a Od[UURURURUUUUS9n XR :aUS- nMYUR UR5 Mv SSS5 XV4$![aXn [R"SURU 5 UR5 UR UR5 Sn A MSn A ff=f!,(df  XV4$=f)aEnrich a batch of assets. Uses a single DB session for the entire batch, committing after each individual asset to avoid long-held transactions while eliminating per-asset session creation overhead. Args: rows: List of UnenrichedReferenceRow from get_unenriched_assets_for_roots extract_metadata: If True, extract metadata for each asset compute_hash: If True, compute hash for each asset interrupt_check: Optional non-blocking callable that returns True if the operation should be interrupted (e.g. paused or cancelled) hash_checkpoints: Optional dict for saving/restoring hash progress across interruptions, keyed by file path Returns: Tuple of (enriched_count, failed_reference_ids) rN)r)rrxrrrrrzFailed to enrich %s: %s) r$rr)rrxenrichment_levelrarrrr) rrrrrenriched failed_idsrrrrs r7enrich_assets_batchrs2HJ  TC*/@/@ 4(!mm!$!1!1 \\%5!-$3%5  333MH%%c&6&67% 2    4 93==!L !!#"2"233 4)  2  sBC:AB)C:+BC: C7A C2,C:2C77C:: D )FF)TF)TFNN)HrrHpathlibrtypingrrrrKapp.assets.database.queriesrrr r r r r rrrrrrrrrapp.assets.services.bulk_ingestrrapp.assets.services.file_utilsrrrrapp.assets.services.hashingrr$app.assets.services.image_dimensionsr$app.assets.services.metadata_extractr app.assets.services.path_utilsr!r"r#app.database.dbr$r&r9RootTyper?r2rRrUrjr4r|rrr>rtuplerrrrrrrdictrrr-r6r7rs //$ LIF +y  . /  T#Y JS J d3i2$) % 9 9!9 9  X_ 9D8C( 49   53#7 DI (, C$ 9C$HC$!%C$ C$  4 C# -. C$N $d=1 $SX $# $ % 3       B"159=EEE E  E  Eb$h'$.E3./$6E ET"159= 5 5 5 5 b$h'$. 5 3./$6 5  3S > 5 r6