3j`%SSKrSSKJrJr SSKJrJr SSKJrJ r J r SSK r /SQr \R"\5r\ "S5r\ "S5r\\\ R&\4\4r\\\4r\\-r\"SS 55r\\\\\/\\4r\"S S 55r\"5r\\S '0q\\ \\4\ RBRD4\S '\\ \\4\\4r#0q$\#\S'\\\\ \\44r%0q&\%\S'0q'\%\S'0q(\%\S'S\\\-S-S\\\-S-S\\\-S-S\)\ \\44Sjr*SS.S\+SS4Sjjr,S\S\S\ RBRD4Sjr-S\ RBRDS\S\SS4S jr.S!\\\-S-S\\4S"jr/SSSS#.S$\\\-S-S%\\\-S-S&\\\-S-SS4S'jjr0SSSS(.S)\\\-S-S*\\\-S-S+\\\-S-SS4S,jjr1S-\S\\4S.jr2S-\S\S\S/\ \\4SS4 S0jr3SSS1.S2\S3\S\S\S4\\-S5\+S6\+SS4S7jjr4SS8.S9\\S:\\S;\+S\+4S<jjr5SS=.S\S\S>\\S?\S-SS4 S@jjr6SSSSA.SB\SC\)\ \\4S-SD\+S?\S-SS4 SEjjr7SS=.S\S\S>\\S?\S-SS4 SFjjr8SPSGjr9SSH.SI\SD\+SS4SJjjr:SSH.SK\\\\/\+4SD\+SS4SLjjr;SSH.SM\\\/\+4SN\SD\+SS4SOjjr>T-- -    3 3 3r& dsl_namesN op_symbols dispatch_keys remove_keyscU(avU=R[[U55-slU=R[[U55-slU=R[[U55-slgU=R[[U55-slU=R[[U55-slU=R[[U55-slg)a Update filter sets as (current | new) or (current ~ new). Args: dsl_names: DSL names to add/remove from filter op_symbols: Operation symbols to add/remove from filter dispatch_keys: Dispatch keys to add/remove from filter remove_keys: If True, remove keys from filter; if False, add them Note: Uses set.discard as it doesn't raise an exception if the element wasn't in the set to begin with. N)r,set_resolve_iterabler-r.)r2r5r6r7r8s r'update_FilterState.updateIs(  OOs#4Y#?@ @O   $5j$A B B    3'8'G#H H  OOs#4Y#?@ @O   $5j$A B B    3'8'G#H H r&cX[URURUR5$)z Build a set of dictionary keys based on the current filter state. Returns: set[tuple[str, str]]: Set of (op_symbol, dispatch_key) tuples )_build_key_setr,r-r.)r2s r'build_disable_key_set"_FilterState.build_disable_key_setfs* OO        r&c.SnUS- nUS- n[UR5Hup#USUSUS3- nM US- n[UR5Hup$USUSUS3- nM US- n[UR5Hup%USUSUS3- nM U$) z-Return string representation of filter state.zFilter State: z === DSL: ===  z:  z === OP SYMBOL: === z === DISPATCH KEYS: === ) enumerater,r-r.)r2sidslopkeys r'__str___FilterState.__str__ss   0FA 4s"SE$ $A1 %%t//0EA 4s"RD# #A1 )) 3 34FA 4s"SE$ $A5r&r)F)rrrrr rr:r,r!r"r-r.rr$r3rr<tupler@rLr%rr&r'r)r),s5 5JC5!#6KS6$S9NCH9-D4" I#&-I(3-'$.IXc]*T1 I  I  I:  s5c?';  r&r) _filter_state_libs_graphs_dsl_name_to_lib_graph_dispatch_key_to_lib_graph_op_symbol_to_lib_graphr5r6r7r0c^[5mS[[[-S-S[SS4U4SjjnU"U[5 U"U[ 5 U"U[ 5 T$)a+ Build a set of dictionary keys based on filter criteria. Args: dsl_names: DSL names to include in key set op_symbols: Operation symbols to include in key set dispatch_keys: Dispatch keys to include in key set Returns: set[tuple[str, str]]: Set of (op_symbol, dispatch_key) tuples entriesNgraph_lib_dictr0ct>[U5nUH&nX1;dM XHnTRU5 M M( g)z;Helper to add matching keys from graph_lib_dict to key_set.N)r;add)rVrWresolved_entriesentryrKkey_sets r'_append_to_set&_build_key_set.._append_to_sets9-W5%E&)0CKK$1&r&)r:r!r _MappingTyperRrTrS)r5r6r7r]r\s @r'r?r?s_ %(EG %x}$t+ %=I %  %945:67="<= Nr&F)print_inactiver`cR[R5Huupn[SU<SU<35 [U5HeupEUR(d U(dMSUSUR <SUR <3nU(aUSUR<3- n[U5 Mg M g)zn Print all override graphs for debugging purposes. Args: print_inactive: Whether to print inactive nodes zop=z, key=rDz: node.dsl_name=z, node.unconditional_override=z node.active=N)rQitemsprintrFrrr)r`rJrK node_listrHr/rGs r'_print_override_graphsres!(  9 Wv +GA{{nns"3T]]$44St7R7R6TU!>T[[N++Aa ,!0r&rrc~X4nU[;a([RRSSU5[U'[U$)z Get or create a torch.library.Library instance for the given key. Args: op_symbol: The operation symbol dispatch_key: The dispatch key Returns: torch.library.Library: The library instance atenIMPL)rPtorchlibraryLibrary)rrrKs r'_get_or_create_libraryrls:  #C %]]**66<Hc :r&libr/cpURURURUUR(+SS9 g)z Register a single node implementation with the library. Args: lib: The torch.library.Library instance node: The override node to register dispatch_key: The dispatch key for registration T) with_keysetallow_overrideN)implrrr)rmr/rs r'_register_node_implrrs7HH  333  r&iterablecjUc/$[U[5(a[U[5(aU4$U$)z Resolve various input types to a consistent iterable of strings. Args: iterable: String, iterable of strings, or None Returns: Iterable[str]: Consistent iterable output ) isinstancerr!)rss r'r;r;s5 h ) )Z#-F-F{ Or&)enable_dsl_namesenable_op_symbolsenable_dispatch_keysrvrwrxc[RSUUU5 [RUUUSS9 [ UUU5nUH)nUupVU[ ;dM[ XV[ U[S9 M+ g)aO Re-enable overrides by removing them from filter state and reregistering. Args: enable_dsl_names: DSL names to re-enable enable_op_symbols: Operation symbols to re-enable enable_dispatch_keys: Dispatch keys to re-enable Note: This function uses reverse filter state management (removing from filters to enable). z>Re-registering ops by dsl: %s, op_symbol: %s, dispatch_key: %sT)r8 filter_stateN)loginforOr<r?rQ_register_overrides_from_graph)rvrwrxr\rKrrs r'r r s$HHH  %3%G"% '> +M  r&)disable_dsl_namesdisable_op_symbolsdisable_dispatch_keysrrrc[RSUUU5 [RXU5 [R 5nUH*nUupVU[ ;dM[ UU[ U[S9 M, g)aC De-register overrides by updating filter state and reregistering graphs. Args: disable_dsl_names: DSL names to disable disable_op_symbols: Operation symbols to disable disable_dispatch_keys: Dispatch keys to disable Note: This function uses filter state management to selectively disable operations. z>De-registering ops by dsl: %s, op_symbol: %s, dispatch_key: %srzN)r|r}rOr<r@rQ_cleanup_and_reregister_graph)rrrr\rKrrs r'rr=ss$HHH *@UV%2$G$G$IG"% '> ) *   r&rc[5n[R5H5uup#nUH'nURU:XdMUR U5 M3 M7 [ U5$)zGet list of operations registered by a specific DSL. Args: dsl_name: Name of the DSL to query. Returns: Sorted list of operation names registered by the DSL. )r:rQrbrrYsorted)r operationsr_nodesr/s r'rrisTJ!(D}}(y)"1 * r&rKcS[[[[[[44S[S[[[4SS4SjnU"[X5 U"[ X5 U"[ X#5 g)z Update the registration mapping dictionaries. Args: dsl_name: The DSL name op_symbol: The operation symbol dispatch_key: The dispatch key key: The dictionary key tuple registrationsymbolrKr0Nc^URU5nUcU/nX0U'gURU5 g)z;Helper to add key to registration list or create new entry.N)getappend)rrrK entry_lists r'_get_new_entry_or_append;_update_registration_maps.._get_new_entry_or_appends7 "%%f-  J#-   c "r&)dictr!listrNrRrTrS)rrrrKrs r'_update_registration_mapsr{sm& #3U38_ 556 # #38_ #  #3XC4iE7Kr&)allow_multiple_overriderbackend lib_symbolrqrrc US:wa[SUS35eX#4n[RU/5nUR[ UUUUUS95 U[U'[ XX7S9 g)a Register a passed override function to the dispatcher. Actually a graph-building operation; real registration happens later. Args: backend: The backend name (DSL name) lib_symbol: Library you're overriding symbols in (must be "aten") op_symbol: Name of the operation you're overriding dispatch_key: Dispatch key to override impl: Implementation function for the override allow_multiple_override: Allow overriding an existing override unconditional_override: Implementation doesn't have a fallback and doesn't require torch.DispatchKeySet as the first argument Raises: ValueError: If lib_symbol is not "aten" rgz.Unsupported lib_symbol (must be "aten", got: "")rrrrr)rKN) ValueErrorrQrrrr) rrrrrqrrrKop_graphs r'r r st8VI*UVWXX  #C{{3#H OO%#9  GCLg,Hr&force_reregisteroriginal_graph new_graphrcU(agX:g$)a' Determine if a graph needs reregistration based on changes. Args: original_graph: The original graph before modification new_graph: The graph after modification force_reregister: If True, always reregister regardless of changes Returns: bool: True if reregistration is needed Tr)rrrs r'_should_reregister_graphrs"  &&r&rzgraphr{cTX4nU[;a[U U(a [UUUUS9 gg)a= Clean up existing library and reregister a graph. This is the common pattern used across reorder, deregister, and reenable operations. Args: op_symbol: The operation symbol dispatch_key: The dispatch key graph: The graph to register filter_state: Optional filter state for conditional registration rzN)rPr~)rrrr{rKs r'rrs:$  #C e| #J &   %   r&)keys_to_processreregister_overridesr{transformation_fnrrc \UbUO[[R55n[U5HupVXV4[;aM[[XV45nU"XVU5n[U[5(d-[RS[U5RUU5 MqU[XV4'U(dM[XxSS9(dM[!UUUUS 9 M g![[ [ [4a [RSUUSS9 M[a [RSUU5 Mf=f) ad Apply a transformation function to graphs and optionally reregister. This is the core pattern used by reorder_graphs_from_user_function and can be reused for other graph transformation operations. Args: transformation_fn: Function to transform each graph keys_to_process: Keys to process, or None for all graphs reregister_overrides: Whether to reregister changed graphs filter_state: Optional filter state for conditional registration Note: If transformation_fn raises an exception for a specific graph, that graph will be skipped and processing will continue with remaining graphs. NAGraph transformation failed for %s/%s. Preserving original graph.Texc_infoNUnexpected error in graph transformation for %s/%s. Preserving original graph.zbGraph transformation returned invalid type %s for %s/%s. Expected list. Preserving original graph.Frrz)r:rQkeysr TypeErrorrAttributeError RuntimeErrorr|warning Exception exceptionrutyperrr) rrrr{ target_keysrrrrs r'_apply_graph_transformationrs76+6C RI$)T** KKtY((   .7)* $< % %  *)  U$5:~|D  KKS     MM`    s C0D+ D+*D+cX4n[U6nUH@nSnU(aURU5nU(a[XVU5 SUlM9SUlMB g)z Register all overrides in a single graph. Args: op_symbol: The operation symbol dispatch_key: The dispatch key graph: List of override nodes to register filter_state: Optional filter state for conditional registration TFN)rlr3rrr)rrrr{rKrmr/enables r'r~r~_sS  #C # &C !//5F  < 8DKDKr&c`[R5HupUup#[UUU5 M g)zG Perform all registration calls from previously-built override graphs. N)rQrbr~)rKrrrs r'_register_all_overridesr~s/mmo "% &    &r&)rfnc[UUS9 g)a Reorder override graphs using a user-provided ordering function. Args: fn: User-provided function that takes (op_symbol, dispatch_key, graph) and returns a reordered graph reregister_overrides: Whether to reregister graphs that have changed Note: This function uses the common graph transformation pattern and can serve as an example for other graph manipulation operations. rrN)r)rrs r'r r s" 1r& filter_fnc v^S[S[S[[S[[4U4Sjjn[UUS9 g)a Apply a filter function to remove nodes from graphs. This is a convenience function that uses the graph transformation pattern to filter out unwanted nodes. Args: filter_fn: Function that takes (op_symbol, dispatch_key, node) and returns True to keep the node, False to remove it reregister_overrides: Whether to reregister modified graphs Example: # Remove all nodes with "deprecated" in the DSL name _apply_graph_filter( lambda op, dk, node: "deprecated" not in node.dsl_name, reregister_overrides=True ) Note: If filter_fn raises an exception for a specific graph, the original graph will be preserved and processing will continue. rrrr0c>UVs/sHnT"XU5(dMUPM sn$s snf![[[[4a [R SUUSS9 Us$[ a [RSUU5 Us$f=f)z-Apply filter_fn to graph with error handling.rTrrrrrrr|rrr)rrrr/rs r'filtering_transformation5_apply_graph_filter..filtering_transformations %*WUTi QU.VDUW WW:~|D  KKS   L  MM`  L  s%+&&++2B"BBrNr!rrr)rrrs` r'_apply_graph_filterrsB8&)26}2E m , 21r& condition_fn ordering_fnc z^^S[S[S[[S[[4UU4Sjjn[UUS9 g)a Apply reordering only to graphs that match a condition. This allows for more targeted reordering operations. Args: condition_fn: Function that takes (op_symbol, dispatch_key) and returns True if the graph should be reordered ordering_fn: Ordering function to apply to matching graphs reregister_overrides: Whether to reregister modified graphs Example: # Only reorder CUDA operations _apply_selective_reordering( condition_fn=lambda op, dk: dk == "CUDA", ordering_fn=lambda op, dk, g: sorted(g, key=lambda n: n.dsl_name), reregister_overrides=True ) Note: If condition_fn or ordering_fn raises an exception for a specific graph, the original graph will be preserved and processing will continue. rrrr0c>T"X5nU(a T"XU5$U$![[[[4a [R SUUSS9 Us$[ a [RSUU5 Us$f=f![[[[4a [R SUUSS9 Us$[ a [RSUU5 Us$f=f)z=Apply ordering_fn conditionally based on condition_fn result.rTrrr)rrrshould_reorderrrs r'conditional_transformation?_apply_selective_reordering..conditional_transformations ))BN"  "9EBB" G:~|D  KKS   L  MM`  L  z><H  W !     d    s,A:2A7"A76A7:2C."CCrNr)rrrrs`` r'_apply_selective_reorderingrsH<))&))26}2E) m ))V 41r&)r0N)=loggingcollections.abcrr dataclassesrrtypingrrr torch.libraryri__all__ getLoggerrr|rrDispatchKeySet _OpOverrideFn _OpReplaceFnr#rr!rr r)rOr"rPrrNrjrk _GraphsTyperQr_rRrSrTr:r?r$rerlrrr;r rrrr rrrr~rr rrrr&r'rs.(22 ! cN CLU%9%91%<=q@A 1~  $  3T-%894 ;NNO TT Tp+n |,79tE#s(OU]]22 2385c?D$778 CeCHo../ (* )+-L-(**!Xc]"T)!hsm#d*!#&-! sCx !H6;dt&cAVAV(   &3CF (hsm 3d :x}*040437 2DIo,2T#Y-2S /D0 2  2n151548 )T#Y-)d3i$.)c?T1 )  )Xc$#L#L#L#L sCx #L  #LZ%*#(/I /I/I/I /I , & /I"/I!/I /Il# '''M"' '  ':)-          %    L48!&(, N%NsCx)D0N N % N  Nl)-       %    >  ""' 4"'5c=147855 5x"' LC:t+,LL L  Lr&