3jv6$%SSKrSSKrSSKrSSKJr SSKJr SSKrSSKJ r SSKJ r J r J r Sr S r0r\\S 4\S '"S S \\5r\"SS9"SS55r\"SS9"SS 55rS1S\R,S\S-S\S-4SjjrS\\\4S\S-4Sjr\ S\S\\\4S\4Sj5r\ SSS.S\S\S\S\S-S\S-S\4 S jj5r\ SSSS!.S\S\S\S\S-S\\\4S\S-S"\\\4S-S\4S#jj5r\ S2S$\S\\\4S"\\\4S-S%\S-S\4 S&jj5rS\S-S\SS4S'jrS1S$\S\\\4S"\\\4S-S(\S-S\4 S)jjrS*\S\4S+jr "S,S-5r!\!"5r"S.r#S\\\4S\\\44S/jr$S0r%g)3N) dataclass)Enum) constants)hf_raise_for_status http_backoffvalidate_hf_hub_args<iXetConnectionInfoXET_CONNECTION_INFO_CACHEc\rSrSrSrSrSrg) XetTokenTypereadwriteN)__name__ __module__ __qualname____firstlineno__READWRITE__static_attributes__rT/home/wildlama/miniconda3/lib/python3.13/site-packages/huggingface_hub/utils/_xet.pyrrs D ErrT)frozenc*\rSrSr%\\S'\\S'Srg) XetFileData file_hash refresh_routerN)rrrrstr__annotations__rrrrrrs Nrrc4\rSrSr%\\S'\\S'\\S'Srg)r  access_tokenexpiration_unix_epochendpointrN)rrrrr#r$intrrrrr r sMrresponser)returnc"UcgUR[Rn[RUR;a!UR[RSnOUR[R nUbUO[RnUR[R5(a>UR[RRS5URS55n[UUS9$![ a gf=f)a2 Parse XET file metadata from an HTTP response. This function extracts XET file metadata from the HTTP headers or HTTP links of a given response object. If the required metadata is not found, it returns `None`. Args: response (`httpx.Response`): The HTTP response object containing headers dict and links dict to extract the XET metadata from. Returns: `Optional[XetFileData]`: An instance of `XetFileData` containing the file hash and refresh route if the metadata is found. Returns `None` if the required metadata is missing. Nurl/)r!r") headersrHUGGINGFACE_HEADER_X_XET_HASH$HUGGINGFACE_HEADER_LINK_XET_AUTH_KEYlinks&HUGGINGFACE_HEADER_X_XET_REFRESH_ROUTEKeyErrorENDPOINT startswithHUGGINGFACE_CO_URL_HOMEreplacerstripr)r+r)r!r"s r!parse_xet_file_data_from_responser;$s$$Y%L%LM  9 9X^^ K$NN9+Y+YZ[`aM$,,Y-]-]^M$/xY5G5GH A ABB%--i.O.O.V.VWZ.[]e]l]lmp]qr #  sAD"D D Dr0cU[RnU[Rn[U[R5n[UUUS9$![ [ [4a gf=f)a` Parse XET connection info from the HTTP headers or return None if not found. Args: headers (`dict`): HTTP headers to extract the XET metadata from. Returns: `XetConnectionInfo` or `None`: The information needed to connect to the XET storage service. Returns `None` if the headers do not contain the XET connection info. N)r)r'r() r!HUGGINGFACE_HEADER_X_XET_ENDPOINT%HUGGINGFACE_HEADER_X_XET_ACCESS_TOKENr*#HUGGINGFACE_HEADER_X_XET_EXPIRATIONr5 ValueError TypeErrorr )r0r)r'r(s r&parse_xet_connection_info_from_headersrBGsp9FFGyNNO #GI,Y,Y$Z [ !3  j) ,sAAA'&A' file_datac^URc [S5e[URU5$)a Utilizes the information in the parsed metadata to request the Hub xet connection information. This includes the access token, expiration, and XET service URL. Args: file_data: (`XetFileData`): The file data needed to refresh the xet connection information. headers (`dict[str, str]`): Headers to use for the request, including authorization headers and user agent. Returns: `XetConnectionInfo`: The connection information needed to make the request to the xet storage service. Raises: [`~utils.HfHubHTTPError`] If the Hub API returned an error. [`ValueError`](https://docs.python.org/3/library/exceptions.html#ValueError) If the Hub API response is improperly formatted. z>The provided xet metadata does not contain a refresh endpoint.)r"r@#_fetch_xet_connection_info_with_url)rCr0s rrefresh_xet_connection_inforF`s/.&YZZ .y/F/F PPr)revisionr) token_typerepo_id repo_typerGcUbUO[RnUSUSUSURS3nUS:wdUbUSU3- nU$)a Build the URL used to fetch or refresh a Xet access token for a given repo. Args: token_type (`XetTokenType`): Type of the token to request: `"read"` or `"write"`. repo_id (`str`): A namespace (user or an organization) and a repo name separated by a `/`. repo_type (`str`): Type of the repo (e.g. `"model"`, `"dataset"`, `"space"`, `"bucket"`). revision (`str`, `optional`): The revision of the repo to get the token for. endpoint (`str`, `optional`): The endpoint to use for the request. Defaults to the Hub endpoint. Returns: `str`: The fully-qualified URL of the token refresh endpoint. z/api/zs/z/xet-z-tokenbucketr/)rr6value)rHrIrJrGr)r.s rxet_connection_info_refresh_urlrN|s_4$/xY5G5GH JeI;b z7G7G6H OCH 4 8*~ Jr)rGr)paramsrOc:[UUUUUS9n[XtXbSU3S9$)aa Uses the repo info to request a xet access token from Hub. Args: token_type (`XetTokenType`): Type of the token to request: `"read"` or `"write"`. repo_id (`str`): A namespace (user or an organization) and a repo name separated by a `/`. repo_type (`str`): Type of the repo to upload to: `"model"`, `"dataset"` or `"space"`. revision (`str`, `optional`): The revision of the repo to get the token for. headers (`dict[str, str]`): Headers to use for the request, including authorization headers and user agent. endpoint (`str`, `optional`): The endpoint to use for the request. Defaults to the Hub endpoint. params (`dict[str, str]`, `optional`): Additional parameters to pass with the request. Returns: `XetConnectionInfo`: The connection information needed to make the request to the xet storage service. Raises: [`~utils.HfHubHTTPError`] If the Hub API returned an error. [`ValueError`](https://docs.python.org/3/library/exceptions.html#ValueError) If the Hub API response is improperly formatted. )rHrIrJrGr)-)cache_key_prefix)rNrE)rHrIrJrGr0r)rOr.s r(fetch_xet_connection_info_from_repo_inforSs<J *  C /sVXccdeldmVn oorr.rRc[XX#S9n[RU5nUb[U5(dU$[ SXUS9n[ U5 [ UR5nUc [S5e[[R55H-up[U 5(dM[RUS5 M/ [[5[:a+[R[[[555 U[U'U$)a; Requests the xet connection info from the supplied URL. This includes the access token, expiration time, and endpoint to use for the xet storage service. Result is cached to avoid redundant requests. Args: url: (`str`): The access token endpoint URL. headers (`dict[str, str]`): Headers to use for the request, including authorization headers and user agent. params (`dict[str, str]`, `optional`): Additional parameters to pass with the request. Returns: `XetConnectionInfo`: The connection information needed to make the request to the xet storage service. Raises: [`~utils.HfHubHTTPError`] If the Hub API returned an error. [`ValueError`](https://docs.python.org/3/library/exceptions.html#ValueError) If the Hub API response is improperly formatted. )prefixNGET)r0rOz6Xet headers have not been correctly set by the server.) _cache_keyr get _is_expiredr rrBr0r@listitemspoplenXET_CONNECTION_INFO_CACHE_SIZEnextiter) r.r0rOrR cache_key cached_inforespmetadatakvs rrErEs<3II+// :K;''  sF CD5dllCHQRR.4467 q>> % ) )!T 28  $%)GG!%%d40I+J&KL,4i( OrcUc[RnUSUS3n[[R 55H1nUR U5(dM[R US5 M3 g)zgReset the XET connection info cache for the given repo type and repo id. Used when a repo is deleted. NrQ|)rREPO_TYPE_MODELrZr keysr7r\)rJrIrUres r(reset_xet_connection_info_cache_for_repork s_ -- {!G9A &F +002 3 <<   % ) )!T 24rrUc"UR5VVs0sHupEUR5U_M nnnURSS5nSRS[ U=(d 0R5SS955nUSUSUSU3$s snnf)z;Return a unique cache key for the given request parameters. authorization&c34# UHupUSU3v M g7f)=Nr).0rerfs r _cache_key..sd1cQCq*1csc US$)Nrr)xs r_cache_key..s ^_`a^br)keyrh)r[lowerrXjoinsorted) r.r0rOrUrerf lower_headers auth_header params_strs rrWrWs.5mmo>odaQWWY\oM>##OR8Kd28L8L8NTb1cddJXQse1[M:, 77?sB connection_infocfUR[[R"55[-:*$)z2Check if the given XET connection info is expired.)r(r*time!XET_CONNECTION_INFO_SAFETY_PERIOD)rs rrYrY s$  0 0C 4DGh4h hhrc*\rSrSrSrSrSrSrSrg)XetSessionHolderi%a'Holds an optional XetSession; supports safe re-creation after sigint_abort or fork. Thread-safe: a ``threading.Lock`` guards all state mutations, which matters for free-threaded Python (3.14t) where multiple threads can race on ``get()`` or ``sigint_abort()`` without the GIL serialising them. cT[R"5UlSUlSUlgN) threadingLock_lock_session _session_pidselfs r__init__XetSessionHolder.__init__-s^^%  (,rc$UR [R"5nURbURU:waSUlURcSSKJn U"5UlXlURsSSS5 $!,(df  g=f)zReturn the current session, creating one if needed. Fork-safe: if the current process PID differs from the PID that created the session (i.e. we are in a forked child), the old session is discarded and a fresh session is created for this process. Nr) XetSession)rosgetpidrrhf_xetr)r current_pidrs rrXXetSessionHolder.get2scZZ))+K}}(T->->+-M!% }}$- *  $/!==ZZs A*B BcUR URb)URR5 SUlSUlSSS5 g![a N#f=f!,(df  g=f)zMAbort the current session and clear it so the next get() creates a fresh one.N)rr sigint_abort Exceptionrrs rrXetSessionHolder.sigint_abortJs\ ZZ}}(MM..0!% $(!Z! Zs-AA A AAAA A+)rrrN) rrrr__doc__rrXrrrrrrr%s- !0 )rrc*[R5$)aReturn the global :class:`hf_xet.XetSession`, creating it on first call. The session is shared across all calls within a process, just as the HTTP client returned by :func:`~huggingface_hub.utils._http.get_session` is shared. It is created lazily and is fork-safe and thread-safe. )_GLOBAL_XET_HOLDERrXrrrget_xet_sessionrYs  ! ! ##rcUR5VVs0sHupUR5S:wdMX_M snn$s snnf)zReturn a copy of headers with the authorization header removed. Xet storage requests use a short-lived xet access token for auth, so the Hub authorization header must not be forwarded to xet storage endpoints. rm)r[rz)r0ryrMs rxet_headers_without_authrcs5 *1 [:3CIIK?rs1  ! EE%'!!&<>4%8 89>3  $  $  #PT* `knr`r FDcNGX[_G_2QQ#s(^Q QQ6   !!! ! Dj ! Dj ! !!H  $(+p+p+p +p Dj +p #s(^ +pDj+p cNT !+p+p+p\%)#' 7 7 #s(^7 cNT !7Dj 7  77t 3d 3S 3UY 38C8$sCx.8$sCx.4:O8Y\_cYc8or8i!2iti .).)b&'$\d38n\c3h\&r