9j%xSSKrSSKrSSKrSSKrSSKrSSKrSSKrSSKrSSKrSSK r SSK J r SSK J r SSKJr SSKJrJr SSK Jr SSKrSSKrSSKJr SS KJrJrJrJrJrJrJrJ r J!r!J"r"J#r#J$r$J%r%J&r&J'r'J(r(J)r)J*r*J+r+J,r,J-r-J.r.J/r/J0r0J1r1J2r2J3r3J4r4J5r5J6r6J7r7J8r8J9r9J:r:J;r;Jr>J?r?J@r@JArAJBrBJCrCJDrD S rE\E"5urFrGrHS \I4S jrJ\J"\GS S9rKSfSjrL\L"SSS9rMSrNSrOSrPSrQSrRSrSSrTSrUSrVSrWSrXSrYSrZS r[S!r\S"r]S#r^S$r_S%r`S&raS'rbS(rcS)rdS*reS+rfS,rgS-rhS.riS/rjS0rkS1rlS2rmS3rnS4roS5rpS6rqS7rrS8rsSgS9jrtS:ruS;rvS<rwS=rxS>ryS?rzS@r{SAr|SBr}SCr~SDrSErSFrSGrSHrSIr\"\B"5\6"5\="5\5"5/5=(a \"5(+rSJrSKrSLr"SMSN\ GR5r"SOSP\ GR5r"SQSR\ GR5rSSr"STSU5rSVrShS \4SWjjrSiSX\IS \4SYjjrSZrS[r"S\S]\5rSjS^\I\4S_jjrS`\S \4Sajr\ SkSb\Sc\\S \4Sdjj5rSerg)lN)contextmanager)partial)Path)OptionalUnion)mock)AcceleratorState),check_cuda_fp8_capabilitycompare_versionsgatheris_aim_availableis_bnb_availableis_clearml_availableis_comet_ml_availableis_cuda_availableis_datasets_availableis_deepspeed_availableis_dvclive_availableis_fp8_availableis_fp16_availableis_habana_gaudi1is_hpu_availableis_import_timer_availableis_matplotlib_availableis_mlflow_availableis_mlu_availableis_mps_availableis_musa_availableis_neuron_availableis_npu_availableis_pandas_availableis_pippy_availableis_pytest_availableis_schedulefree_availableis_sdaa_availableis_swanlab_availableis_tensorboard_availableis_timm_availableis_torch_versionis_torch_xla_availableis_torchao_available*is_torchdata_stateful_dataloader_availableis_torchvision_availableis_trackio_availableis_transformer_engine_available%is_transformer_engine_mxfp8_availableis_transformers_availableis_triton_availableis_wandb_availableis_xpu_available str_to_boolc[5(a9S[RR5[RR4$[ 5(a9S[RR5[RR4$[ SS9(aSS[RR4$[ 5(aSSS4$[5(a9S[RR5[RR4$[5(a9S [RR5[RR4$[5(a9S [RR5[RR4$[5(a9S [R R5[R R4$[#5(a9S [R$R5[R$R4$['5(a9S [R(R5[R(R4$[+5(a9S[R,R5[R,R4$SSS4$)Nxlacudaz2.0) min_versionmpscgNrr?W/home/wildlama/miniconda3/lib/python3.13/site-packages/accelerate/test_utils/testing.pyget_backend..\r@mlusdaamusanpuxpuhpuneuroncpucgr>r?r?r@rArBrClrDr@)r+torchr9 device_countmemory_allocatedrrr;current_allocated_memoryrrEr&rFrrGr!rHr5rIrrJr rKr?r@rA get_backendrRTsejj--/1L1LLL   uzz..0%**2M2MMM e ,a;;;;   a""   eii,,. 0J0JJJ   uzz..0%**2M2MMM   uzz..0%**2M2MMM   eii,,. 0J0JJJ   eii,,. 0J0JJJ   eii,,. 0J0JJJ   224ell6S6SSSa""r@returnc SS/nUR5HSup#[U[5(aU(aURSU35 M7UcM<URSUSU35 MU U$)z Wraps around `kwargs` to help simplify launching from `subprocess`. Example: ```python # returns ['accelerate', 'launch', '--num_processes=2', '--device_count=2'] get_launch_command(num_processes=2, device_count=2) ``` acceleratelaunchz--=)items isinstanceboolappend)kwargscommandkvs rAget_launch_commandr`rseX&G  a  1 NNRs8 $ ] NNRs!A3< (  Nr@g?) num_processesmonitor_intervalFc[RUn[U5nU$![a [SUS35ef=f![a UnU$f=f)NzIf set, z must be yes or no.)osenvironr6 ValueErrorKeyError)keydefaultvalue_values rAparse_flag_from_envrlsp B 3  B 'F M Bxu,?@A A B  MsA #= AARUN_SLOW)ric:[R"S5"U5$)z+Decorator that skips a test unconditionallyzTest was skipped)unittestskip test_cases rArprps ==+ ,Y 77r@cD[R"[S5"U5$)z Decorator marking a test as slow. Slow tests are skipped by default. Set the RUN_SLOW environment variable to a truthy value to run them. z test is slow)ro skipUnless_run_slow_testsrqs rAslowrvs    ? JJr@cJ[R"[S:HS5"U5$)zm Decorator marking a test that must be only ran on the CPU. These tests are skipped when a GPU is available. rLztest requires only a CPUrort torch_devicerqs rA require_cpurzs#   |u46P QR[ \\r@cJ[R"[S:gS5"U5$)z Decorator marking a test that requires a hardware accelerator backend. These tests are skipped when there are no hardware accelerator available. rLtest requires a GPUrxrqs rArequire_non_cpur}s"   |u46K LY WWr@cx[R"[5=(a [5(+S5"U5$)z Decorator marking a test that requires CUDA. These tests are skipped when there are no GPU available or when TorchXLA is available. r|)rortrr+rqs rA require_cudars.   02S;Q;S7SUj klu vvr@c[R"[5=(a [5(+=(d [ 5S5"U5$)z Decorator marking a test that requires CUDA or HPU. These tests are skipped when there are no GPU available or when TorchXLA is available. ztest requires a GPU or HPU)rortrr+rrqs rArequire_cuda_or_hpurs=      =%;%=!=TBRBTVr  r@cL[R"[5S5"U5$)zf Decorator marking a test that requires XPU. These tests are skipped when there are no XPU available. test requires a XPU)rortr5rqs rA require_xpurs!   /13H I) TTr@c[5=(a [5(+n[5n[R"U=(d US5"U5$)z Decorator marking a test that requires CUDA or XPU. These tests are skipped when there are no GPU available or when TorchXLA is available. ztest requires a CUDA GPU or XPU)rr+r5rort)rrcuda_condition xpu_conditions rArequire_cuda_or_xpurs? '(I1G1I-IN$&M   ~>@a bcl mmr@cJ[R"[S:gS5"U5$)z: Decorator marking a test that should be skipped for XPU. rIztest requires a non-XPUrxrqs rArequire_non_xpur#   |u46O PQZ [[r@cJ[R"[S:gS5"U5$)z: Decorator marking a test that should be skipped for HPU. rJztest requires a non-HPUrxrqs rArequire_non_hpurrr@cL[R"[5S5"U5$)zb Decorator marking a test that requires FP16. These tests are skipped when FP16 is not supported. ztest requires FP16 support)rortrrqs rA require_fp16rs"   024P QR[ \\r@c[5n[RR5(a[ 5(dSn[ 5(a[ 5(aSn[R"US5"U5$)z` Decorator marking a test that requires FP8. These tests are skipped when FP8 is not supported. Fztest requires FP8 support) rrNr9 is_availabler rrrort)rrfp8_is_availables rA require_fp8rsa() zz  )B)D)D .00    /1L Mi XXr@cP[R"[SS5S5"U5$)N>=z2.5.0z$test requires FSDP2 (torch >= 2.5.0))rortr*rqs rA require_fsdp2rs$   /g>@f ghq rrr@cL[R"[5S5"U5$)zf Decorator marking a test that requires MLU. These tests are skipped when there are no MLU available. ztest require a MLU)rortrrqs rA require_mlur!   /13G H SSr@cL[R"[5S5"U5$)zh Decorator marking a test that requires SDAA. These tests are skipped when there are no SDAA available. ztest require a SDAA)rortr&rqs rA require_sdaar !   024I J9 UUr@cL[R"[5S5"U5$)zh Decorator marking a test that requires MUSA. These tests are skipped when there are no MUSA available. ztest require a MUSA)rortrrqs rA require_musarrr@cL[R"[5S5"U5$)zf Decorator marking a test that requires NPU. These tests are skipped when there are no NPU available. ztest require a NPU)rortr!rqs rA require_npurrr@cL[R"[5S5"U5$)zr Decorator marking a test that requires Neuron. These tests are skipped when there are no Neuron Cores available. ztest require Neuron Cores)rortr rqs rArequire_neuronr"s"   246Q RS\ ]]r@cL[R"[5S5"U5$)zw Decorator marking a test that requires MPS backend. These tests are skipped when torch doesn't support `mps` backend. z0test requires a `mps` backend support in `torch`)rortrrqs rA require_mpsr)s"   /13e fgp qqr@cn[R"[5=(a [5S5"U5$)zn Decorator marking a test that requires transformers and datasets. These tests are skipped when they are not. z$test requires the Hugging Face suite)rortr2rrqs rArequire_huggingface_suiter1s3   !#?(=(?.  r@cL[R"[5S5"U5$)z] Decorator marking a test that requires datasets. These tests are skipped when they are not. z"test requires the datasets library)rortrrqs rArequire_datasetsr;s"   468\ ]^g hhr@cL[R"[5S5"U5$)za Decorator marking a test that requires transformers. These tests are skipped when they are not. z&test requires the transformers library)rortr2rqs rArequire_transformersrB"   8:S TU^ __r@cJ[R"[S:S5"U5$)z} Decorator marking a test that requires a multi-device setup. These tests are skipped on a machine without multiple devices. r<z,test requires multiple hardware accelerators)rortrOrqs rArequire_multi_devicers#   |a/1_ `aj kkr@cz[R"[RR 5S:S5"U5$)zw Decorator marking a test that requires a multi-GPU setup. These tests are skipped on a machine without multiple GPUs. r<ztest requires multiple GPUsrrqs rArequire_multi_gpurs0   uzz6681<>[ \]f ggr@cz[R"[RR 5S:S5"U5$)zw Decorator marking a test that requires a multi-XPU setup. These tests are skipped on a machine without multiple XPUs. r<ztest requires multiple XPUsrrqs rArequire_multi_xpurs0   uyy557!;=Z [\e ffr@c[R"[5=(d [5=(a [S:S5"U5$)z Decorator marking a test that requires a multi-GPU setup. These tests are skipped on a machine without multiple GPUs or XPUs. r<z#test requires multiple GPUs or XPUs)rortrr5rOrqs rArequire_multi_gpu_or_xpurs;      2 0 2H q8HJo  r@cL[R"[5S5"U5$)zt Decorator marking a test that requires DeepSpeed installed. These tests are skipped when DeepSpeed isn't installed ztest requires DeepSpeed)rortrrqs rArequire_deepspeedrs"   579R ST] ^^r@cx[R"[SS5=(a [SSS5S5"U5$)zf Decorator marking a test that requires TP installed. These tests are skipped when TP isn't installed rz2.3.0 transformersz4.52.0zGtest requires torch version >= 2.3.0 and transformers version >= 4.52.0)rortr*r rqs rA require_tprs>   w'\,<^TS[,\Q  r@cxUc[[US9$[R"[ SU5SU35"U5$)z Decorator marking that a test requires a particular torch version to be tested. These tests are skipped when an installed torch version is less than the required one. )versionrztest requires torch version >= )rrequire_torch_min_versionrortr*)rrrs rArrsC 0'BB   /g>Babiaj@k lmv wwr@cL[R"[5S5"U5$)zx Decorator marking a test that requires tensorboard installed. These tests are skipped when tensorboard isn't installed ztest requires Tensorboard)rortr(rqs rArequire_tensorboardrs"   79;V WXa bbr@cL[R"[5S5"U5$)zl Decorator marking a test that requires wandb installed. These tests are skipped when wandb isn't installed ztest requires wandb)rortr4rqs rA require_wandbrs!   135J KI VVr@cL[R"[5S5"U5$)zp Decorator marking a test that requires trackio installed. These tests are skipped when trackio isn't installed ztest requires trackio)rortr/rqs rArequire_trackior"   357N OPY ZZr@cL[R"[5S5"U5$)zr Decorator marking a test that requires comet_ml installed. These tests are skipped when comet_ml isn't installed ztest requires comet_ml)rortrrqs rArequire_comet_mlrs"   468P QR[ \\r@cL[R"[5S5"U5$)zh Decorator marking a test that requires aim installed. These tests are skipped when aim isn't installed ztest requires aim)rortrrqs rA require_aimrs!   /13F G RRr@cL[R"[5S5"U5$)zp Decorator marking a test that requires clearml installed. These tests are skipped when clearml isn't installed ztest requires clearml)rortrrqs rArequire_clearmlrrr@cL[R"[5S5"U5$)zp Decorator marking a test that requires dvclive installed. These tests are skipped when dvclive isn't installed ztest requires dvclive)rortrrqs rArequire_dvcliverrr@cL[R"[5S5"U5$)zp Decorator marking a test that requires swanlab installed. These tests are skipped when swanlab isn't installed ztest requires swanlab)rortr'rqs rArequire_swanlabrrr@cL[R"[5S5"U5$)zn Decorator marking a test that requires pandas installed. These tests are skipped when pandas isn't installed ztest requires pandas)rortr"rqs rArequire_pandasr !   246L Mi XXr@cL[R"[5S5"U5$)zn Decorator marking a test that requires mlflow installed. These tests are skipped when mlflow isn't installed ztest requires mlflow)rortrrqs rArequire_mlflowrrr@cx[R"[5=(a [5(+S5"U5$)z Decorator marking a test that requires pippy installed. These tests are skipped when pippy isn't installed It is also checked if the test is running on a Gaudi1 device which doesn't support pippy. ztest requires pippy)rortr#rrqs rA require_pippyrs.   13N@Be fgp qqr@cL[R"[5S5"U5$)z Decorator marking a test that requires transformers engine MXFP8 block scaling available. These tests are skipped when transformers engine MXFP8 block scaling isn't available z5test requires transformers engine MXFP8 block scaling)rortr1rqs rA require_transformer_engine_mxfp8r1s(   -/1h  r@cL[R"[5S5"U5$)zp Decorator marking a test that requires torchao installed. These tests are skipped when torchao isn't installed ztest requires torchao)rortr,rqs rArequire_torchaor;rr@cL[R"[5S5"U5$)zv Decorator marking a test that requires matplotlib installed. These tests are skipped when matplotlib isn't installed ztest requires matplotlib)rortrrqs rArequire_matplotlibrBs"   68:T UV_ ``r@cD[R"[S5"U5$)z Decorator marking that a test requires at least one tracking library installed. These tests are skipped when none are installed zYtest requires at least one tracker to be available and for `comet_ml` to not be installed)rort_atleast_one_tracker_availablerqs rArequire_trackersrPs'   &c  r@cL[R"[5S5"U5$)z Decorator marking a test that requires torchdata.stateful_dataloader. These tests are skipped when torchdata with stateful_dataloader module isn't installed. z+test requires torchdata.stateful_dataloader)rortr-rqs rA%require_torchdata_stateful_dataloaderr[s(   246c  r@cn[5(a%SSKnURRS5"U5$U$)a Decorator marking a test with order(1). When pytest-order plugin is installed, tests marked with this decorator are guaranteed to run first. This is especially useful in some test settings like on a Gaudi instance where a Gaudi device can only be used by a single process at a time. So we make sure all tests that run in a subprocess are launched first, to avoid device allocation conflicts. If pytest is not installed, test will be returned as is. rNr<)r$pytestmarkorder)rrrs rA run_firstrgs0{{  #I.. r@cB\rSrSrSrSr\S5r\S5rSr Sr g) TempDirTestCaseizat A TestCase class that keeps a single `tempfile.TemporaryDirectory` open for the duration of the class, wipes its data at the start of a test, and then destroys it at the end of the TestCase. Useful for when a class or API requires a single constant folder throughout it's use, such as Weights and Biases The temporary directory location will be stored in `self.tmpdir` TcJ[[R"55Ulg)zECreates a `tempfile.TemporaryDirectory` and stores it in `cls.tmpdir`N)rtempfilemkdtemptmpdirclss rA setUpClassTempDirTestCase.setUpClasss(**,- r@c[RRUR5(a![R "UR5 gg)z1Remove `cls.tmpdir` after test suite has finishedN)rdpathexistsrshutilrmtreers rA tearDownClassTempDirTestCase.tearDownClasss0 77>>#** % % MM#** % &r@cUR(awURRS5HWnUR5(aUR 5 M*UR 5(dMA[ R"U5 MY gg)z>KKM[[]]MM$' 1 r@r?N) __name__ __module__ __qualname____firstlineno____doc__r classmethodrrr__static_attributes__r?r@rArrzs9N..&& (r@rc,^\rSrSrSrU4SjrSrU=r$)AccelerateTestCaseiz A TestCase class that will reset the accelerator state at the end of every test. Every test that checks or utilizes the `AcceleratorState` class should inherit from this to avoid silent failures due to state being shared between tests. cN>[TU]5 [R"S5 g)NT)supertearDownr _reset_state)r __class__s rAr%AccelerateTestCase.tearDowns %%d+r@r?)rrrrrr%r  __classcell__)r's@rAr"r"s ,,r@r"c^\rSrSrSrS\\R\\R44Sjr Sr g)MockingTestCaseiau A TestCase class designed to dynamically add various mockers that should be used in every test, mimicking the behavior of a class-wide mock when defining one normally will not do. Useful when a mock requires specific information available only initialized after `TestCase.setUpClass`, such as setting an environment variable with that information. The `add_mocks` function should be ran at the end of a `TestCase`'s `setUp` function, after a call to `super().setUp()` such as: ```python def setUp(self): super().setUp() mocks = mock.patch.dict(os.environ, {"SOME_ENV_VAR", "SOME_VALUE"}) self.add_mocks(mocks) ``` mocksc[U[[45(aUOU/UlURH.nUR 5 UR UR 5 M0 g)a! Add custom mocks for tests that should be repeated on each test. Should be called during `MockingTestCase.setUp`, after `super().setUp()`. Args: mocks (`mock.Mock` or list of `mock.Mock`): Mocks that should be added to the `TestCase` after `TestCase.setUpClass` has been run N)rYtuplelistr,start addCleanupstop)rr,ms rA add_mocksMockingTestCase.add_mockssF) >>UUG A GGI OOAFF #r@)r,N) rrrrrrrMockr/r4r r?r@rAr+r+s)" $uTYYTYY%?@ $r@r+cF[5nUSR5RUR5n[ U5R 5nUSR 5n[ URS5H#n[R"X#U5(aM# g g)NrFT) r clonetodevicer rLrangeshaperNequal)tensorstatetensorsis rAare_the_same_tensorsrBs  E D\   ! $ $U\\ 2FVn  "G AY]]_F 7==# ${{7:v..% r@c\rSrSrSrSrg) _RunOutputic(XlX lX0lgN) returncodestdoutstderr)rrGrHrIs rA__init___RunOutput.__init__s$  r@)rGrIrHN)rrrrrJr r?r@rArDrDsr@rDcf# UR5IShvN nU(a U"U5 OgM+N7frF)readline)streamcallbacklines rA _read_streamrQs, __&&  TN  &s 1/1c h^^^^ # U(a[SSRU55 [R"US/USSQ7U[RR [RR US.6IShvN n/m/mS U4Sjjm [R "[R"[URUU 4Sj55[R"[URUU 4Sj55/US 9IShvN [UR 5IShvN TT5$NN)N7f) Nz Running:  rr<)stdinrHrIenvc>URS5R5nURU5 T(d [X0US9 gg)Nutf-8)file)decoderstripr[print)rPsinkpipelabelquiets rAtee_stream_subprocess..tees8{{7#**, D %D )r@c2>T"UT[RSS9$)Nzstdout:r^)sysrH)loutr`s rArB$_stream_subprocess..QSZZ_hAir@c2>T"UT[RSS9$)Nzstderr:rc)rdrI)reerrr`s rArBrgrhr@)timeout)) r[joinasynciocreate_subprocess_exec subprocessPIPEwait create_taskrQrHrIrD) cmdrUrTrkr_echoprjrfr`s ` @@@rA_stream_subprocessrws  mSXXc]+,, A QR!!&&!!&&   A" C C* ,,    QXX7i j k    QXX7i j k    AFFHnc3 //E 6%s7A9D2?D,BD2D.D2!D0" D2.D20D2rtc h[U5H)upg[U[5(dM[U5X'M+ [R "[ XX#XES95nSRU5n URS:a9SRUR5n [SU SURSU 35eU$)N)rUrTrkr_rurSr 'z' failed with returncode z, The combined stderr from workers follows: ) enumeraterYrstrrnrunrwrmrGrI RuntimeError) rtrUrTrkr_rurAcresultcmd_strrIs rAexecute_subprocess_asyncr s# a  VCF[[+C^co pFhhsmG 16==)y1&2C2C1DE::@ C  Mr@c[RRSS5n[R"SSUS[R 5n[ U5$)z Returns an int value of worker's numerical id under `pytest-xdist`'s concurrent workers `pytest -n N` regime, or 0 if `-n 1` or `pytest-xdist` isn't being used. PYTEST_XDIST_WORKERgw0z^gwrlr)rdregetresubMint)workers rApytest_xdist_worker_idr s= ZZ^^15 9F VVFB244 0F v;r@c"Sn[5nX-$)z Returns a port number that can be fed to `torch.distributed.launch`'s `--master_port` argument. Under `pytest-xdist` it adds a delta number based on a worker id so that concurrent tests don't try to use the same port at once. in[SSRU5SURR535UeSnAff=f)z Runs `command` with `subprocess.check_output` and will potentially return the `stdout`. Will also properly capture if an error occurred while running `command` N)rIrUrYrWz Command `rSz$` failed with the following error: )r{rYrr|rdrecopyrp check_outputSTDOUThasattrrYCalledProcessErrorrrmoutput)r] return_stdoutrUrArres rA run_commandr:s '" a  QGJ# {jjoo ((9J9JPST vx((w/M   ( (%)**PQRQYQYQ`Q`QbPc d  sAB++C=?9C88C= componentscz[[R"[55RnUR "U6$)z Get a path within the `accelerate` package's directory. Args: *components: Components of the path to join after the package directory. Returns: `Path`: The path to the requested file or directory. )rinspectgetfilerUparentjoinpath)raccelerate_package_dirs rApath_in_accelerate_packagerQs/"'//*"=>EE ! * *J 77r@exception_classmsgc## SnSv SnU(a[ SUS 35eg![aYn[X05(dSUS[U535eUb&U[U5;dSUS[U5S35eSnANuSnAff=f7f) z Context manager to assert that the right `Exception` class was raised. If `msg` is provided, will check that the message is contained in the raised exception. FNTzExpected exception of type z but got zExpected message 'z' to be in exception but got 'rzz but ran without issue.) ExceptionrYtyper|AssertionError)rrwas_ranrs rAassert_exceptionr`sGd  :?:KKbcdd d!--p1L_L]]fgklmgnfo/pp- ?#a&= c$6se;YZ]^_Z`Yaab"c c=ds+B #B  BAB<B BB c[R"5n[RnU[lU"U0UD6 U[lUR 5$![anUeSnAff=f!U[lf=f)zX Takes in a `func` with `args` and `kwargs` and returns the captured stdout as a string N)ioStringIOrdrHrgetvalue)funcargsr\captured_outputoriginal_stdoutrs rAcapture_call_outputrssjkkmOjjO%$  df%  # # %% % s#A A' A""A''A** A7)F)NN)NNNFF)NNFT)FNrF)rnrrrdrr rprdrro contextlibr functoolsrpathlibrtypingrrrrNrUr?r utilsr r r rrrrrrrrrrrrrrrrrrr r!r"r#r$r%r&r'r(r)r*r+r,r-r.r/r0r1r2r3r4r5r6rRryrOmemory_allocated_funcr/r`DEFAULT_LAUNCH_COMMANDrlrurprvrzr}rrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrranyrrrrTestCaserr"r+rBrDrQrwrrrrrr|rrrZrrr?r@rArs&  %" $------------`#65@M1 l1D&,,Y\]  &j%@8 K]XwUn\\]Y$sTVVT^riqaoeqhjqa`lhg_xcW[]S[[[YYrir[a  79;O;QSgSijk$ ! ##  &(h''(B ,** ,$h''$B&0bl&0R$fp&  i c. 8C 8D 8eiehsmetee$ &r@