3j SSKrSSKJrJr SSKJr \R "\5r\"5r S\RS\RRS\R4SjrSS\RRS\RS \RS \RS \RS-S \S \S-S\S-S\S-S\S-S\RS-S\\RS44Sjjrg)N)_flash_attention_forward!flash_attn_supports_top_left_mask)loggingquerymodulereturncUR[R:XaURRn[R "U5(a[R "U5$[URS5(aURR$[SUR555RR$g)ziIf the query is in float32, return a target dtype compatible with flash attention. Return None otherwise. _is_quantizedc3|# UH2n[U[RR5(dM.Uv M4 g7f)N) isinstancetorchnnLinear).0layers c/home/wildlama/miniconda3/lib/python3.13/site-packages/transformers/integrations/flash_attention.py #get_target_dtype..s*b+;%z%QVQYQYQ`Q`?a+;s-< <N) dtyperfloat32devicetypeis_autocast_enabledget_autocast_dtypehasattrconfignextmodulesweight)rr device_types rget_target_dtyper" s {{emm#ll''  $ $[ 1 1++K8 8 V]]O 4 4==&& &b6>>+;bbiioo o keyvalueattention_maskdropoutscalingsliding_windowsoftcap is_causals_auxc  XU RSS5(a[RS5 URSn [ SUR55(a [ S5eUR SS5nUR SS5nUR SS5n[X5n U bU O URn [UUUU4U U UUUU[U URR[US5(a UROSU bU RUR 5OSS . U D6nUS4$) Noutput_attentionsFzFlash Attention does not support `output_attentions=True`. Please set your attention to `eager` if you want any of these features.rc3*# UH oS:Hv M g7f)rN)rdims rr*flash_attention_forward..1s +{!8{szTensor query has shape with a zero dimension. FlashAttention does not support inputs with dim=0. Please check your input shapes or use SDPA instead. layer_idx) query_lengthr+r' softmax_scaler)r*use_top_left_mask target_dtypeattn_implementationr4r,)getlogger warning_onceshapeany ValueError transposer"r+r_use_top_left_maskr_attn_implementationrr4tor)rrr$r%r&r'r(r)r*r+r,kwargsseq_lenr8 attn_outputs rflash_attention_forwardrGs@zz%u-- W kk!nG +u{{ +++ B  OOAq !E --1 C OOAq !E$E2L'2 8H8HI*     %,!"MM>>&-fk&B&B&""  HHU[[ !%( )K.  r#)gNNNNN)rmodeling_flash_attention_utilsrrutilsr get_logger__name__r;rATensorrModulerr"floatintbooltuplerGr0r#rrRs1 h   H %68 ELL %((// ekk ( !% !!%C HHOOC <<C C << C LL4' C  CT\C$JCT\Cd{C <<$ C 5<< Cr#